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iusor II is the second, ;lntelligent coaputer aided * 
instruction (ICAI) prograa that has been developedT to aonxtor the 
progress of, and offer suggestions to, students playi^ng iuapus, a 
coaputer gaae designed to teach logical thinking a&d probiea solving, 
proa th^B eatlier efforts nith iusor I, it was possible to produce a 
rillerbased expert wihich possessed a relatively coaplete mastery of 
the gaae* Susor II- endeavors to teach the knowlea^e eabodJ.e(l in the 
tiiles*used by the expert. The student lodel represents llusor/|S 
estimation of the student's knowledge of these rui^s, and this 
estiaati^on is based priaarily^on ai^yses of the^player's moves* The 
student aodel allows iusor to ^tscWalize its explanations to the 
student according to the student's current knowledge of the gaae* The 
result is a system -which, accordiifg to preliminary r^su^^ts, is highly 
effective a±a.tutoring students of varied abilities. Thirtythree 
references are listed. (Author/LLS) % 
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Uuaor II 18 tha second prograa that has been developed to tutor 
etudenta In the gaae of Uuapus.. Froe the earlier efforts MUh Uus6r I \( 
uaa povaibia to produce a rule-based expert uhich poiseese^ a ralativaly 
complete aastaru of the gaae. Uueor II endeavour e to teach the knouledge 
aMbodiad in tba ruiae ussd bg the Expert. The Studaht nod|el reprasente 
Uueor^s estiaation of the etudant*s l^nouledge of eaiti rulae, and thie 
aetiMtion is based priaari'lg on analyeee of the player* s Movee. The 
9«jdant tlodal allOMs Uusor to personal ize ite explanatione to the etudant 
according to tha student's current knouledge of the gaae. Tha raeult le 
a ayatea which, according to praliainary raeulte^ ie highly effective at 
tytoring students of veried abilities. 



' This report deecribes research done at the Artificial Intelligence 
Laboratory of the llaeeachusatts Institute of Technology. It ua« 
auppoftad in part by tha DIvieion for ^tudy and Research in Educationt 
naaaachuaetts Institute of Technology and hae been eubaittad to tha 
\* ' Dapartaant of nathaaatice In partial fulfilljiant of tha raquiraaente for 
^ a Maatar of Science Dagrae under the supervieion of\ Profeeeor fra 

^ Goldatein of tha Dapartaant of Electrical Engineari^ng/ Coaputar Science. 
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The yumpus f^wUor ' The IntroiuQtion 

V 

Tfie /ntrocfuct I on 
Chapter // 

One of the puf poses of our ecfucational eystem is to teach better 
Maye to think' about problems in gensrai. This is a key just i f i cat i on ^f or 
the etudy of higher yathematics and the sciences by the general student* 
SiMildrly, ^gdNies can be"' an idea| teaching instrument. Most games 
represent eoMe facet o^ life brut in a much B»rnlpr donftiin, thereby 
atlOMing tt)e student to devekjp.his problem solvirHg abilities in an 



environment which is more conducive to learning, Such^,games can be fun 
MKile Reaching valuable skillSs. However/ students canjreach a plateau in 
their ga^e playing and ceaare ta try new stratej^K<^ When this occurs,^ 
the learning process halts. A sol ution^J^thls, problem is to encourage 
-the student to Improve by oc^ionally offering suggestions regarding 

r 

improved game strategics, Unfor tunatejy, the cost of providing human 
teachers to Match the game (and offer suggest tone) is prohibitive, 
Houaver, it re possibli^o use a computer to monitor the /progress of the 
game and to offer Suggestions Mhen warranted. Uith this goal in minb, a 
program wis urittsn to serve as just su^ an advisor for a computer game 
referred to as "Uumpus huqt ing** of "fJumpus" ^ • ^ ^ ^ 

The relationship of the Uumpus 'Advisor to^the player is illustrated 
in Figure The Advisor analyzes the interaction between the game and 

the player, giving advice' when appropriate, Uhen the Uumpus Advieor 



(i) 



The game of Uumpus was originally described Ypb i^ Creative 
Computing, and this particular var iat ion was implemented in LfSP by Greg 
Clemeneon, ' • * 
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The Vumpui Advisor' TAe Introduction 

cHootet to givt advice, it can intercept the player's messages to the 



.ga«e and allow the player to modifu hie move if he 00 desires. Also, 
from the play«r*t point of vieu, the Uumpus Adv*isor receives exactly the 
same infomation $i the player, The^yumpus Advisgr can altsr the game 
(shown in dotted linss) to a certain dsgree. It does so to create 



f situations which ^e aiore conducive to learning. 

Figure !•! 
I Conceptual Model of a Tutor, 
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✓ Game 
^ Modifications 



The game j^Uumpus" is an example of a game which encourages 

deductive procssses and devsiops a senss of probabi I i i . ss. The player 

must seek out and kill a monster, ths Uumpus, The playsr moves the 

Uluwpus's wairren, a network of interconnecting caves containing the Uumpus 

> * 

and other dangers, namely bats and pits* At ths start of the'^game the 

player is told the number of cavss in the warren and the nun\ber of>bdts 



and pi W\ 



(i i) 



Balg^e evsry moys the player is told which cave he is m 



and the neighboring caves that he can movs to, if any of the 

neighboring caves contain a bat he will bs informed that he hears 



(it) 



In a normal game, there are twenty 'caves, •thrss pits, -and three 



caves wi th bate. 

Each cave is idsntifisd by number, 
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The Introduction 



squddking. LikQuiso, if a neighboring cava contains a pit) the player^ 
wi IJ be rnfbrmed of a draft (as pits are bottomleds chasms), but in 
neither case is the player told which of* the *caves are dangerous. 
Whenever the piayer is uithin tuo caves of the Uumpus he will smell its 
hor^tble* stench. If the player,, enters a cave with «*pit he loses t-he 
game, whereas if he enters a cave containing a bat, he will be carried to 
a random cave which may contain another* bat, a pit, or the Uumpus. The 
Ulumpus east's unwary players who stumble ^into his lair. The player tries 
to visit enough caves (avoid*) ng bats and pits) to locate the Uumpus 
without ac'tually entering its cave. Once the player has /found the 
Uumpus, he can shoot an arrow into the Uumpus' lair irom a neighboring 
cave, killing ^he beast. If the player shoots an arrow into a cave and 
the Uumpus is not there, his arrow will ricochet through the warren at 
random for roughly four caves and may kill «ither the player or the 
Uumpus. In Figure 1.2 part of a possible warren is shown. 




13 bat 



STENCH 



• Cii^cTed caues have been visited. 
Upper Case: Given Facts 
Lower Case: De^t Ions 

Playing \h% game can Involvt eiinple deductions and' risk 
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r-Ae Vumpus Advisor, TUb Introduction 

^ AiniiRiZdt ions an ueUi as more c^Aplax strategies and consideratiop^. .At 
^ Xhm tiinpiest level » the, player can deduce that certain caves 
ah60lut9ly safo by the absence of uarnings. These caveft shouJd be 
explored before any othere. At a higher level the player can perceive 
that certain caves arB^proi>ably saffi^ i.e. less likely to contain dangers 
than other caves. Thaae perceptions are based on the patterns of the 
uarnings and require application of' probabi I istic heuristics uhich are 
comnonly 'used by knou i edgeab i e persons. An advanced ^p layer can usually 
deduce the exact'' location of the Uumpus through a q^ite thorough 
application of logic, but rpost players develop a general idea of its 
location^ ut thout completing al l the required deductions (though they are 
urong often enough. to encourage then to improve their deductive poi^ers)'. 
There are also unusual situations uhictk require' very advanced 
Coneiderat ione of the risks involved in order to select the best move. 
The Uumpus is a game that can be enjoyed by the beginner aSfuell as the 
advanced player. • 

In the development of the Advisor. tMo different generations of 
programs have been uri.tten. They are referred to as Uusor I (Uumpus 
Advisor^ I) and Uusor II. For the sake of perspective, the* next chapter 
-^will discuss the development of Uusor I, and then the remainder, of the 
paper ui II discuss Uusor II. the mo^t recent UumpXis Advisor.' 
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The Wmpus Advisor ' . I Uusor I »' 

Tfi* Or^tginst \'/unfpum Advi man • , Wumon I 

Chaptmr 2 




Uusor I can be vieuied as a continuation of the uibrkT Burton and 
Brown ri975) with the game of West. Ues^t is an algebraic game for which 
they developed an Advisor program. However, Uest was a relatiyeiy simple 
domain which was not conducive to more advanced Advisors. As a resl?|t, 
it was decide;i that Uumpus was a dom^ain that uas sufficiently diificult. 
to allow the development of more advanced Advisors, though it was still 
simple enough tb allow the development of a funct i ona I - program. Uith 
this ^oal in mjnd, work was b&gun on- Uusor I. 

Uusor I was written as a course project for nine graduate students 
at n.I.tf with its development being supervised by Jim Stansfield and Ira 
Goldstein. As the Uumpus Advisor was required to discern the quality of 
the ^different moves as Jj^'' ^^'^ explain itself when 

appropriate, it quickly became a very complex program. To keep everything 
manageable, the program was written in a modular fashion. This aided in 
the development of the Advisor in it allowed the modules to be written, 
debugged, and modified relatively independ^t ly. After its initial 
development, Uusor I was extensively modified by the'author. 

Uusor I had three main modules and several tub-m.odul es. The' three 
main modules were the .Executive, the Bat/Pi t> Locator , and the Uumpus 
Locator. ^''^ Associated with the three main modules were various' sub- 



Uusor r is ful I y described in Stansfield, Carr, and Goldstein (1376). 

The 9at/Pi t Locator was written with the help of Uill dinger. John 
Avgoustis, and Fred Knowle. The Uumpus Locator was originally written by 



Page 7 P 



ERIC 



Tk0 Vmpus A49isor ^ 



Vusor I 



Fl9urt 2.1 < * 

Dotted Wmn riprtMnt tignif leant flout of InforMtlon. 
^lid llntt illMtrato thi hitrarehu of eontftol. 



• \ 



/ 

0 

) . \ 



Route 
Plainner 






Wuirpus 

Advisor 

Executive 






>■ 


Wun^us 
Game 











Executive 
E valuator 




Combination 




Combination 




Wumpus 


Evaluator 




Explainer 




Evaluator 




f 






r 


1 4 














Bat/Pit 





'Bat/Pit • 




Evaluator 




Explainer 





Executive 
Explainer 




Wun^us. 
Explainer 



ERIC , 



'3 



The' Vumpus Advisor Uu^or I 

modules which are illustrated in Figure 2.1. Each of the Locator modules 
had two sections, the Eva I ua tor section whtch comfiuted the meri^j^of the 
various caves, and the Explainer section whfch explained the results of 
the Eva I ua tori AIsS, the Bat/Pit Locator Ka^wo^evels, the level which 

^ considered bats and pits separately, and - the Combination level which 
combined these resoUts. Finally, the 'Execut i ye Evaluator combined the 
results from the Bat/Pi t 'Eva 1 uator and the Uumpus Evatuator to come upf 
with an overall I utility for each cave. Then the, i^xecutl ve had the option 
of cajling upon the Explainer routines to generalfe explanations for the 
student. This structure is rather contorted' anci unnecessarily hard to 

" Xinderstand, but this is primarily due to an incoirlplete understanding of 
the domain at. the start of the project. However, ^rom the work on Uusor 
I it was possible to gain many insights wh^ch finally led to the 
development of Uusor II* ^ 

The Bat/Pit Locator computed an sstimatB of the probability that 
any cave contained a bat or a pit, but the Uumpus Locator was not. 
advanced enough to arrive at estimation of the risk's from the Uumpus; it 
only determined which caves could not contain the Uumpus and which caves 
were likely to return information about the Uumpus* location. ^.'''^ The 
Executive Evaluator could not directly compare the r i sks / i nvo I ved from 
Bats/Pi te and the Uumpus as it did not have any probability estimates for 
the Uumpus. Instead it broke down the different moves into the eight 
categories shown in Figure 2.2 and evaluated the player's move according 



Neil Rowe, Beth Levin, andflobin Gross*. The Route Planner was written by 
Ginny Grammar. 

The Uumpus Locator was sufficiently advanced to locate theUumpus, 
but it could not deal with incomplete information. 

Page 9 




^ Vusor I 



to these* categories. The different Eva I ua tor' routines taken together 

which poseesetTd a Knowledge of . jthe 



cowprised th^ Uumpus ''Expert' 



(iv) 



gaM. 



Figure 2.2 



Uusor I uses eig|it c lassi f icat ionS for unvisited caves. 

Type 1. A cave that' is aisoiutely safe and that gives information about^ 
the Vumpus. 

Tgpe 2. A cave that is absolutely safe. 

Type 3. A cove thai-^Jtas no bats or pits, but that could contain the 
Uumpus. This Stve inherently gives Uiform<ftion about the Uumpus. • 

Type "4. A cave that might contain bats or a pit, but nh Ihe Vlumpus and 
which gives information aftout thCVumpus. 

Type 5. A cave that might contain bats of a pit, but not the Vlumpus. 

Type's. A cave which could contain batsi pits or the Vumpus. 

Type. 7. A cave that contains a bat. This classification is a very 
special class that has varying value. 

Type 8. A cave that is c^f^ain death. (Either a pit or the Vumpus). 

Throughout the developeent of the Expert, heurietice were always 
used in preference to lengthy calcuiatione. Thie uae partly because the 
exact calculations were so lengthy that it was unrea I i st i c ^ to compute 
' them, but also because such heuristics were, in fact, gsed by humans 
players. This correspondence between human and computer reaswing 

greatly simplified, explanations. An example oj[ this uas the manner in 
uhich the Bat/Pi t Locator determined the I ikel ihood that a cave contained 



ERIC 



The concept of designing tht tutor around an sxpert was developed 
Broun (1973) in his Sophie program. 

In particular, the heuristics were those used ijy th« designers of 
Uusor I. Further experimentation is required to determine how common 
these heurietice are. ^ 



(iv) 
.Bro 

(v) 
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' • . * 

a bat or a pit. It might have been poeeibie to compute the exact 

probability of a cave^containiag a bat or' a pit, but this caicuiation 

Mould have been tim^ consuming and complex, ilorse yet, any explanation of 

aa exact probability uould have, had to discuss the relevant permutations 

and combinations, which would almost certainly have been above the" level 

of the student. I. 

Uusor I had only a very limited model of the user's knouledpe. It 
did not keep track of different players, 'but, instead, asked the user at 
t^e star f of^ each session for an estimation of hi^ ability. For the rest' 
of the session the Expert would make all- of its computations at a level 
of complexity hoped to be si ightly' above that of^the studenf. This had 
the disadvantage that, if the player entered an unrealistic e^'a I uat i oh' of 
his ability, he would either be overwhelmed by material weH above his 
le'vel, cfr he would find the AdvTsor*^ advice over simplified. There wqs 
-alSQ the problem that Wusor .1 did not have, firte gradations ir> the' Level 
of its advice (it had four levels) due to"?the expense of programming the 
Expert to function^at more level^. 

Uusor I was tested on . a very^ThnTte^^basi s and was found to be 
reasonably, effective at' teaching better Uumpus strategies. However, it 
uas mostly used by fl.I.T. related personnel (including children and 
graduate\ students) who, t/e assume, already possessed a logical bent. In 
these caTes it was effective, but it'was not attempjting to teach a better 
uay to think about problem's (as the players already possessed the desired 
thinking habi ts) but merely better ways to think about a part icular 
problem. In those very few cases where it was advising students who did 
not already have the desired thinking habits, the handicaps of Uusor I 

' It * 
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M«rt rttcfj ly* ippartn^. ,^lt WM not"»blt Jo cariful ty |gulde th« player 
through ^ th« »or« Dttic fttept. (ite tltplMt^^^^tl^ wat not basU 1b«>^ 
and tandfd to* confuM £id fru•t^ata t'ht* atuctant. ^acit^ae ^of these 
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Uatu)nt, Mark Mas star tad ;on a/aora-advanead- Uuaput TAdviaoV^wi t^^ a 
^Mora detailed atudant wodaL and tha ^ability to tuna ita aMplanations to 
tha pc|rtiQ)ilar student, - • , 
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^ » 7>ie Expmrt 

Oyfftfteii 0/ tHe Expert 
Fro* tha work ^^hich was dona on tha axpart of .Uuaor I. it was 
poaaibia to davalop a auch mora pouarful and ganaral EKpert. The 
daduct iona^qjj^uirad in locating tha dangaroua cavaa and tha hcuriaticci 
Inacaaaarg to arriva at an estiaation of tha daqg^r^ in cases of 
uncartaintg have ^aan afmplifiad to tha ^j(^oWit uhara thara ia a Ldcator 
Algorithm uhich ret^'fr^9 only very ganaral information (tuch as the 
nuabar pf caves, tha number of bats, how far a bat ^^'""'"S prl^agates. 
* atfi^ to dataraina tha relative dangers of each caya. Tha Locator 
Algorltha has three 43&sic steps as shown in Figure, 3.1., It ie executed 
onca for aac^ danger being considered, and the rasuJ^ ara then combined 
probabl Nat teal ly. the firs^ step is the acceptance and propagation oT^ 
any and all 'infiirJi|t iotn supplied by the t4uapus gaaa. 



fAr^iQT 



Figure 3.1 « 
ret Steps of the Locator Al§oritlm 



First Step .1 ' Secojid Step | 



Third Step 
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r^^ji/ormttoM Propagator. ^ 
For Mch of the throe dangoro th^Ihformtipn Propagator marks each 
cava ui th thraa piacea of inforaat ion, th^ aaKiaua di atance to the 
cloaaat dangar, tha alniauM diatanca^to tha cloaaat danger, and. uhen th^ 
firat two niMbara aliainatt all other poaatbi I it tea, a Marker for the 
^Kact diatanca tb the c loses t danger • Ther^ are eight theoreins uhi ch 
al lou tha propagator to update thia inforaaiion abouj^ a given cave, Th^ 
firat tuo^ara that any tiae a cave is viattad it can be marked as either 
jaora than zero away or aKactly zero &Mjf. ^'^ Also, in the special case 



:tly zero &Mjr. 
isr shoots an i 



of. tha UuMpus, if the player shoots ari arrow into a cave and does no 

kill the Uuapus, then that cave is wore than zero auray.^''' Next, if a 

» 

cave {a visited and ha^ no uarning, then that cava can be ndrked as mora 
than N away, where N i^&^Jbhe distancs that a warning for the givem^anger 

travels. Likauiaa,' if a uarnirrg is sensed, then the cave must be T^ss 

/ 

thM (N^l) away. The' last^ theorems deal uith tha propagation of 

r 

information through the uarren. If a ^iven cave is more than N a\ 
than all of its neighbors must be mora than (H^l) amay^ Conversely 
al I of a cave's neighbors ar^ mora than (N'l) away, then^aid cave can be 
claaaifiad as'^jnora than N away. Vrm Jl^ ove theorems correspond to rules 
zero through aeven shouh in Fi.gure 3.2. Us|ng additional theorems, more 
information could be propa^jated, but theseVight rules Ifre sufficient to 




Except* for bats, the ^classi f ication^ of Htaro away attained in this 
faahion ia rather pointl^s as it also signifies the end of the game^^^^^^ 

^' '^ Note^ that irV som^implementatjins of Uunpus, the Uumpus moves uhen 
an arrow is shot rtr it docs not kill hi*). Uusor 1 1 does not permit 
this primarily because it liquid require degrading the data bdse. This 
could create ' ai tuations uhich uere too complicated to readily be 
aK|^ mined to children. 
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mark each cavF ^it^all the inforiii^Jtion relevant to playing the gaoe. 
.nany caves xan be^aiiiiolNied as being safe Just through the use of the 
mor€ thffi N |wa/ ta^. Thfre are exanplee of the deductive process m 
Figurie 3.3 and 3^4. ^ 



Figure 3.2 
The Logical Rules of the Expert 



" A cave. Canute markgd as ''zero away'' ij it was yisited and found to 
contain a danger. |* 

LI A cave can.: be marked -as "more than zero, away" if it was safety 
H'siiedl' 

L2 // the player shoots an arrow into a cave and does not kill the 
^ Vumpus, then that cave caA be marked as "more than zero away'* 
(Vum/ms). 

L3 // 0 cdM visited ptd there is not a warning, then that cave is 
"more Uan JCiaway'' lihere II is the distance that the warning 
propagates . > 

' - - ^ I ^ • . : 

L4 - If a cave is Hsited^and there is a warning, then that cave is 
^ "lezs than (11*1) \way" . 



L5 // a cave is marked "mo-re than II away" then all of its neighbors 
must be '*lne^e than (V-l) away". ^ 

L6 // all ^f a cavei neighbors are "more than (M-l) away", then it 
must be ""mohfi than II away". 

L7 // a cirve is. "more than (ll-l) away" and "less than (11*1) away**.* 
then it is "H away". - . , 

L8 Vhen t)m\lgorithm is creating cave'sets and it encounters a cave 
which wo\f€d be M caves away but which is alrso "more than II away" . 
then that cave can nof^have any contributions to the cave-set. 

L9 // the player encountered a danger in a cave, then ihe cave does 
not contain a dang^rjij higher priority, i.e. the Vumpus eats the 
player i^fore he cajr fall -into a pit. and he will fall into a pit 
beforw he is picked up by bats. 

L10 ^ tertHn caves can be marked as "more than zero away" based on 
coffjttferettM of th^ different complete ^ceve^sets end the number 
' of dangers. 
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In Figures 3.3 and 3.'4 there is a standard notation for diegrams of 
tt\m uarreh. The nodes of the netuork are numbered and represent caves. 
Circled nuvbere r^preeent' cavee uhich have been visited by the player*. 

To. the top right of each visited cave is a aarker for whether or not any 
uarnlnge ware sensed.* ("U" indicates that a warning was sensed, and a 
"hM" Means that a warning was not sensed) To the b'ot|jM left of each cave 
ie any c iaesi f icat icfn that the cave aay hav^/^ (i.e. more than N. 7e55 
than N, and away) The reader is cautioned that, while the'the diagrams 
of the .warren in the exampjes are very regular (planar), norisallg warrens 
are Huch More randoa* in their' arrangeaentt 

In Figure 3.3, the danger being considered is pits. Hence, 
warnitigs propagate fdf*^ distance of one cave. In Figure 3t3A, the plajg^r 
hae visited two caves, . nsi ther of which hBfi any warnings.^ Therefore, the 
vielted caves are more than one away and all the neighbors are more than 
zaro away (i.e. safe)% - Upon visiting cave 3 (Figure 3.3B) , the priay^r 
raceivee a warning,^ indicating that cave 3 is Ui$ than two away. Since 
it is a^so Mora th^ zero away, it must be one away (i.e. cave 3 is next 
to a pi t)* ^ * 

Kn Figure 3«4 the danger is the t4uapu9 whose warning propagates for 
a distance of two caves. At the start (Figurs 3.4A), the player has 
viaited various caves and has discerned that caves 7 and 19 musti contain 
pits. He has also visited two caves of relevance^^caves 5 and G. ' As- no 
warntngjpTof the Uuapus were sensed, caves 5 and 6 were Marked as more 
than two away. All the neighboring caves were then Mrked as mdre than 



^'•'^ An /interesting enperiaent is to determine whether the restriction 
to regular warrens increases the speed at which paeple learn the game« 

^ ^ / y 
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on« Mf«y.'N«Kt th« player visited c«v« 3 (Figure 3.4B) and sensed^ a 
^ uarning. Ihit indicated that cava 3 uat Us$ thM tbrM may. As it uas 
also fliora than oni a^ay» cave 3 uaa Marked ea being exactly tuo caves 
ffom the Uuepua^ Caves 2 and 4 uera Marked at than zaro away by * 

dint of cave 3*e claaalficati-on^ of More than ona amay. In Figures 3.4C 
and 3.40''the player visited caves 2 and 4 which he kneu to be safe. At. 
theee caves he eensed a uarning and Marked the cavee accordingly* 
Finally he visited cave 9 (Figure 3.4E) and could then conclude that the 
UuMpMS Muat be in cave 1 (by a process to be described later). 

The special classification of'N ca^es amay is nade because it is 
thjB only claasi f icat ion used extensively in the lafbr steps 'of the 
Locator Algorithe. ^n particular, if one can deterMine all caves that 
^ ere exactly. N cavee ^tiay froM a cave which ia classified N away then one 
hee Mlhat is referred to as a coMplete cave-set. (A partial cave-set is 
one in uhich all the cave^ uhich are knoun to be N caves away are listed, 
but the^-.eet Is not necessarily ccMplete). In the case of bats and pits, 
the deterMinat ion .^f the coMplete ca^e-set is especially simple since the 
'only qlasei f icat ion of relevance is one kway and the complete cave-set is 
just the iRMediate neighbors. Cave-sets are important because at least 
oaa laemhar o/ eacA cowpUte caye^set mst coataifi one of the giuen 
dangers. Therefore one cani el ieinate froM the pave-set those cavee uh'ich 
cap not possibly contain the given danger for otner reasons (as indicated 
in the data base). The resuJ t after this eilMination la called a reduced 
cave-^et. (Logical rule L8 inf Figure 3.2 is the forMi|l statement of the 
rule to reduce cave-sets). . : ^ t 

In Figures 3.3 and 3.4 there are severer exaep I es of cave-sets. In 
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Figure 3.3B th« •conplete cave-set ie cavee 6, 7, 8,- and 17. Hoyever, as 
cavee 6 and 7 are both more thM ler.o emey, tH)ft>educed coaplete cave-set 
je Just cavee 8 and 17. This neans that either 8 or 17 eust' contain a 
pit. In Figur* 3.4C th« partial ca'»e-s«t it j:av«« 6, 7, 1, 18, and 9. 
Ae cavee 6, 7, and" 10 are safe froa the l4uMpus, the reduced partial cave- 
set is caves 1 and 9. In Figure 3*40 thoqie is an OKceiient example of 
the application of logical rule L8. The reduced cave-set is caves 1 and 
9, but this cave-set is also a coaplete cave-eet as the neighbors of cave 
4 are knoun and, uhilf the neighbors of cave 18 are not knoun, cave 18 is 
Marked ae^ liore thin one away and none of its neighbors can possibly 
contain the Uuwpus. (Hence they can not be members of any reduced cave- 
^et for the Uuepus). When the player visits cave 9 (Figure 3.4E) he is 
taking a big chance, but once he has vj(8ited it he can eliminate it from 
the reduced complete cave-set (it is more than zero away)* Then the 
player cen conclude that the tlumpus myst be in cave 1 as it is the or^y 
member of the reduced complete cave-set. In all future references, it 



ui I I be assumed that a cave-set is actually a reduced cave-set, since t 
Locatpr^ Algor i thm alyays reduces the cave- set s< 



he 



The Possibility Evaluator 

♦ 

The Possibi J i ty Evaluator marks certain caves as "more, than zero 
ayay" by coneideri^ng the different complece eave-sets and the number of 
dangers. It implements logical rule LIB shown in Figure 3.2. If the 
number of complete cave-sets exceeds the'number of dangers, then it is 
likely that this step of the Algorithm ui 1 1 deduce that certain caves ^an 
not contain a danger. For example, if there are only three caves Mith the 
given flange»", and there are complete cave-set^ of: 
(1.2) 
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k 

(3,4,5) ' ' 

(S,7,8) 

(8,9), ^ . ' ' 

then one. can deduce that caves 6, 7, and 9 must be safe. This means that 

cave 8 Must contain one of the given dangers. The ^eeult after the 

application of the second step ist 

(1,2) 
(3,4,5) 
(8) . * 

An SKplanation for uhy cave 6 must be safe could be, "You can dBduce that 
ca^e.O must be sere as tharh ara oo7y three pits. You know thqt there 
must ba a pit In althar ca\/a 1 or }u5t as you know that there must be 
a ^plt Intone of the caves 3r^i snd ^, Likewise, there must be a pit 
either cave 8 or 9. This accounts for all three pits and hence there can 
not be a pit In cave 6.** 

An algorithm to determine uhich caves are safe in this case is tb 
choose N complete cave-sets that have no interssctions (i.e. no 

menbere in common). Then any caves that are not a member of the union of 
the N cave-sets must, of necessity, be safe. Thsfl&elect ion of the N 
com^^te cave-sets is carried out by eKhausti-vely trying all 
poeeibi I Tt ies. 

Unfortunately, this algorithm does not find all possible caves that 

■ust-b« tafe. For eKaaple. if there are onig tuo dangers and there are^ 

cave-eetet ' I 

(1.2) - * ' ' 

(2.3) 

(1.3) 

(1.3.4). 



N Is the total* nunber of clangers of the type being considered. 
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than cave 4 can not possibly contai^ ona of tha given dangers* An 
algorithm to ,find all safe' caves is to cpnstruct all coabipations of N 
cavee frba the set of all cavesMhat are aeabers of any cave-set, 
sliainatiS coabinations uhich do Aot fulfill the requ'iresiente (i.e^ do not 
have at leaat one cave froa every cave-set), and aarl^ thoee caves Mhich 
are not a aeaber of any of the .reaainind coabinations as safe. Thi^s 
algorithm is roughly as efficient as the first algorithm, but, 
unfortunately, it la soastiaes not poasibis to explain the results of 
this last algorithm ih isinple teres. This Is sspscially true in those 
unusual cases where the first algorithm failed. For en^ple, the 
eMplanation for the eKample above uduid read, "Cava 4 can not contain a 

m 

pit because there are only two pit^. IT a pit were in cave 4, there would 
only be one other pit to explain all the evidence, We know that there 
must be a pit in either cave 2 or cave 3, but if the remaining pit were 
in cave 2 there could act be a pit in one of caves 1 mni^S (and we know 
that there must be a pit in one of caves 1 and 3), Likewise, if the 
remaining pit were in cave 3 there couljl not be a pit in either or cav^s 
1 and 2 (and we know that there must be a pit in one or caves 1 and Z). 
Therefore there can not be a pit in cave 4," If this explanation seems 
rather obtuse, the reader is cautioned that the case explained above is 
the eimplest possible case in which the first algorithnf fails, Host 
other, casee are significantly eore complicated !(and virtually 
uriaxplainableK For thie reason, the first algorithm was used instead 
of tha sscond al(i|oritMa« % ' 



Interested readiere are challenged tofurite an explanation in simple 
terms for Mhy cave 11 can not contain a^it if there are 'three pits and 
cave-eeta 11.7,3,11), (1,2,3), (3,4,5), iSlBJ). (7,8,9i, and (9,l0,l). 
Tha *aMp I anation)^ should not bontain any'nsM terms" l ike "cave-ssts**. 
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The Probat^ility Estimator 
The third step of, the Locator Algorithm eetimatee the probability* 
,,that «ach cave contains a danger. It considers all the cave-sets, 
complete and partial; andjis guided by five basic principles. ♦ "The first 
principle KPll of Figure 3.5) is that each member of a cave-set has an 
aijproximate probability bf 1/N where N is^ the r;)umber ^Df .caves in ^J^^®^ 
cave-eet. In the case of par tial cave-setSi N is an estimate of the 9i«:e . 
qf the complete cave-set. /for example, in Figure 3.4C \he^partial cave- 
set is caves 1 and 3, but N Mould be four as one would expect that the 
neighbors* of cave 4 would add roughly tuo more caves to the cave-set. In 
any case, the probab/l i ty of 1/N is not exact because it is often ^ 
possible that some cave*sets will contain more ihan one dangerous cave. 

4 

However, the estimate does givs a relative measure oi the risks involved 
with the different caves. 

The next^general principle is that if a cave has been identified as 
definitely containing a danger, that cave ''will explain the warnings 
responiibim fdr any cave-sets of which it is a member. This makes 

it less likely that the other members of these cave-sets wi 1 1 contain a 
danger. The' third principle is that if a cave is a member of more than 
one' cave-set# it is more likely that the cave does» in fact, contain a 
dfuiger. Conversely, the ot^r members of these cave-sete are less Mkely, 
to contain dangers. Lastly, it is better to shoot into caves that are 
likely to. contain the Uumpus before visiting thdm. This^ principle 
considere the fact that If the Uumpus ie not In^ the cave, th^n the arrow 



\ 



ERIC 



t^'J Every cave-set ui th more than one member can'be attributed to an 
originatingcdve at which a uarning uas received. 
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Pllt Equal Likelihood Princlpio mi P-l/N MNr« N is ttw mi«Nr •! e«vM m in smiimi 

MMHitt VI Mlilih Mitf Mvf It • M*tr. II n rr n ptwii It INt •lipilfylfif Mtuiiplltn lhal tMh^ 
••V '— I Mi MMiln tfw ii n fi r ranMiry Mtlfwi Is II. ' ^ 



P12| Rodund«i:it Evidonc^ Princi|Llo Uhtn ii it ntM ih«r« ffvtfi mv^-mi is « tup«rMi tf- 

MWltitr My< —I, tlitii 1^ ■lytrn l ^Mvt —I It n» Itiifir oiiwlitrti M Iht ^namlfifs Involvti art 
•MiiUttly mplilfittf Iht tMkttI ttvt ttl* ftr tht ttvtt rtMlnlftf liii iht tup iff I tf Itr Iht 
t^hMl it rtMMii, tht prtMlllty It'ftI Iti 

. " u . . ; 
p- — . - 

T-I-S * . 

Mhtrti U Iht nuiMr tf Itftnllflttf itnftrt. (Tht mNibtr tf initftraftnl ottpltit t«vt-tttt)« 
Us tht mMhtr tf ynlitntlflMl ianftrt. (Iht ItttI mi«btr tf iiwftrt almit. D. 
%m Iht ttl't l -ti y htr tf Mft etvtt Mtti tn Iht prtttnt tvlitntt* 
T» Iht Ititt iMrihtr tf ttvtt* 

THIt prtfcihillly It titt ipflltttolt It ttvtt ftr Mhlth ihtrt It nt tvlitiwt It ttlltalt Iht tftoftr by. 



P13| Hul tipio Evidonco Pr Incipio ftr Ihttt ttvtt thlth trt wiiri tf atrt Ihtn tnt ttv»-ttl Iht 

»lllly It ttl Its — - , 

p, = 1 = 1 X (1 X (1 -if-) X (1 -xj-) X ; 



II N« Iht mMhtr tf ttvtt In Iht f Ivtn ttvt^l tf Mhloh ttii ttvt It t 
Thit tuprtttltfi ttrrt t pt n it It Iht tltpllfylnf tttttptlMi Ihtl tKttlly tnt i t nftr It rm4mm\^ 
tttlfnti It tteh, ttvt-ttl. tilt P(4anftr)Bl^(nt^tn«tr) HhtiH ^ 
P(fit 4tnftr)«P(nt Onftr frt« f IrtI ftvt-ttl)4^ (nt im%%T frtt ttttni ttvt ttl)»» • • 



P14| Adjust Fpr Multlplo Evidoncv Princlpio ftr etvtt i«iith trt titfcirt tf c^vt^it it 
Mhlth tht thtvt ftrwit It tpfllti, tht prththlHtitt trt ttfjtittti ttt 

""r ' - Hf I [fi at;-) * CiB- ii^ • • • ] -^iNT^TT* ["'2A- • •■ • ^ Tspry* • • ■ 

Mhtrti-^ FP» Iht finti prththlllty ftr Iht tpttlflti etvt. 
Mb Iht nui#tr tf ctvtt In tht tpttif lid tt^Httl* 

Iht rrtMhIllly Ifillltlly ttltiilttttf (thtvtl ftr Iht tpttlflti ttvt* 
IW tht nui^tr tf otvt-ttit t1 liilth Iht tpttlf Iti etvt It t Mtttr. 
NiiBtrlt tubttrlptt trt ftr llit vtrltut ttvt«tttt tf Mhleh Iht Ilh ttvt It t Mttbtr* 
Ltlltr tuhtt r irtt tttttlttti tlth iMttrlt tthterlptt trt ftr tht vtrltut tii^iri tf tht tptelfiti 
ttvt # tt; tslttltf tht Ith ttvt* 

ThIt tyrtttitn tvtrtftt tht thtwftt frta fVk kl trniftt Iht tlhtr MtlMrt. H htt nt thttrttltti 
|«ttlf Ittlltrii but II Mtrtt vtry Rlttly* 

P16| Shooting Pri nclpio Uhtfitvtr Py^i^in t wt ttit II It rtttt tti 

FP^^ -(1 - P„) X ; ^W. Pc,, off^ n - PcMt Off J 4' Pcut Off = 
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will start ricocheting with roughly a onqi third chance of killing the 



player.. It it appi iad 



only if theri are iufficlant drrowe so that the 



any explanations but iSre siioply used intarnally to 



loss of an arrow will not enJ^ the game. These five principles are stated 
as rules Mith the-ir aqcoropanying formul-as /in Figure 3.5, The'fprroulas 
are not referred to in 
allOM \h$ Advisor to svaluate the relative nerits of the different moves 
Mre precisely. 

y Combination of the ResiLlts 4 

To complete the cb'mpar i sops 'between the different moves, the Expert 

calls the Locator Algorithm three times, ones for each respective danger. 

Then it combines the probability estimates to g^e up with an overall 

estimation^ ths value of visiting 9Bc\^ cava. Ths Expert is gui'ded by 

(light basic principles in cotrputing the overall evaluations. They are: 

C8: Safe unvisited caves are preferable^ to alht)ther8. ^ 

CI: Given that it is necessar^to take sowis^ risKs, those moves with 
the lower risks for all dangers are preferable. 

C2: Risking mul tiple- dangers is worse than risk^hg a single danger, 
"presuming there is a common dangsr and that the commdti danger is equally 
likely in both cases. V 

C3i Presuming that there i^re^ common dangers'^ jkhat are equaflly 
likely^ it is preferable to visit tHose caves where the Imequal risks are 
lower* 

C4: Bats are. not as dangerous as pits or the Uumpus. 

C5: Locating the Uumpus is an Important' goa I , and it is worthwhil^ 
to visit x:av^s which are likely to glvs information about the Uumpus* 
locat ion. 0 • ' , . 

CSi Uhen the player is in a vsrg dar^rous seciion of the warren 
with no kn^wn roUte to .a safer area, it is sometimes advisable to seek 
out bats iPhsthe hope that they will;.carry ths player to a safer section 
of the uarrerr* 

C7: Uhen the location of the UumpliS is probably known, , it is best 

to ehoot into the cave. 

• «7 • 
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% " , Figure 3.£ 

TK^^onbiMt ion Princi-pi«» were converted into the^ iPo Mowing formulas:" 

XOST- l-tl-C^at^*<lSit^*^l-Cu«iipi-.^ <C8 thru C3) 



Uinii|»Mt Uu«put 



^ur^itr*' (C4) 



N ' -E 



GAIN. V,.,.-hV3., 



V/-B*(1-P,.,^(1-P,J(1-P„„^J ^B) 

- N -E 

yh%r9t Wm TK« probab> 1 1 t^for tht iptcifitd dangtr for tht c«v« ^ting contidtrtd/ 

S» A MAturc of th« v«iu« of tKt infQPMtion to lit 9«ir»«d at that cava. (normaHy on«). 

' It it- ir^rtatad if tRa cava it tiktlj tQ 9iv« infornltlen about tht UuMput. ' 
Hm The nOMbar of cavat tht* typa iptcifitd. 

E« l}n attiMtiOn of tht numbar of cavtt wtth tht tpacifitd ^»f\^9r .that do not contain 
anothar dan^ar of a highar priority. Th« jA^ioritiat froai ht9h«tt to lOHatt art UuMput, pitt, ^ 
aod bau. for axanp.ra'. 



I^Cava* '^Cavti 

Th« abovt forRulat can ba utad to giva an in^^x ofi 

- GAIN 
. INDEX-- 



r,- 



Tha cavot earv than ba ord^rad accordin9 to tha INDEX. If COSTaC, tha INDEX wouid go to mf in/tyf 
thart Mewld^va to ba diffarant tizat of .infinity. Inttaad, if tha COSTse, tha INDEX it aat to 
var^ Hir9t rHMpbar ti»at tht CAIN. I 
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Tfiese principlos ware incorporated^ into the formulae ehoun in Figure 3.6 
and are ueed^ to compute the indeK for each cave. Thie^ index is an 
•etimation of the value of visiting each cave. 

It ie MOrth noting >til^ the Expert described herein does not algays 
find the best move poesible* In se^ral cases 1 1 uas cJecidi^d to use less 
accurate algorithmr in order to eiake the computations of the Expert more 
understandable to humans. An example of this at a global level is the 
manner '^n which c5|ve-dets are implemsnted. In Figure 3.7 there is a 
diagram of a section of the warren. The actual Locator Algorj^hm would 
.conclude that cavers 5t 6, and 7 are all equally likely to contain the 
Uumpue. In fact it i^s more likely t^at cave 6 contains the Uumpus* as a 
Uumpue. in cava 5 or cave 7 does not explain all the warninge directly. 
^ An Improv^ algorithm cdbld^ apply probability rulee throughout the 

propagat'on of cave-eets. A simplistic approach to *thts would be to 

. aieign to cave 3 and cave 4 a probability of one Kdlf of being next to 

r ' ' 

the Uumpus. In this manner one achieves the results shown beneath 

^Figure 3.7* These results are more realistiCt but the improve?! algorithm 

hae the unfortunate .drawback of destroying the precise division between 
- the probability rules and theological rules^ It also makes it much more 

difficult to break the riilee into bite-sized chunks which are ^asy to 

teach. For such Vsasons, the . improved Expert does not carry out its 

computations in the most, accurate manner' possible. 




^^•'^ An additional tonnectTon Ie required .between cave 5 and 7 X\ 
explain all of the warnings.. 

^^'^'^ Thim it one of the general approaches suggested Jn 
Cerr, and Go Ideate in (1976). . » ^ 
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Figure 3.7 
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Probabilities For Vumpus 
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Probabi 1 i tg 
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• 3333m 


.25 % 


6 


.3333 


.58 
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.3333 


.25 



. Th0 tiKtMn danger apecific ruies (th« •ttven tdgicat rules in 

• * 

Figure 3.2, and the five probability rulea in figu^^.S) together Mith 
the eight coabination rulea are a concise defTnition of the Uumpus 
EKparta nany of the intricacies of tha eKpert, such as the priorities of 
the different probabi I i ty* rules uhen there are conflicte, have been 
Minted. Such details uere Morked ovit in the actual prograa, but are not 
Morthy of note In this paper,* The differbnt rules have been presented in 
^and are nunbered in) order of increasing cofflpleKity and* to a certain 
degr9«7<^in order of logical dependency. * Normal I y,« each rule uses only 

the input data and the results of Ipuer numbered rules. The 24 rules 

<» « 
taken together coaprisa the knouledge uhich the Uumpus Advisor endeavors 

to taacha In this eenae* the. entire Uumpus Advisor ^ centers around the 

Expar t*. 
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Th9 VumpHa AdHsor Vusor II 

Thm Improved ]^umpum Adv I mor, Vumor 

/ Chapter 4 ^ ^ 

Th€ Overall Structure 
^ Uusor II has been implemented with the structure shown in Figure 
4.1. • Thb Uumpus Expert modulja is an iapleaentat ion of the expert jus^ 
described^' The Move Comparer analgzes the different moves noting th^ 
•knowledge' required to justify their relative merits/ The Psycho I og i-st 
uses this' information to. determine how the player's actions (moves) 
reflect upon his knowledge of the game and inf^V the Student floctel as 
such. The Student flodel can then decjde what the player is presumed to 
know, and, Jrom this, it determines what* material is, at the student's 
leveU '^*^'Th# Uumpus Aptvisor uses this information (added to the 
results of the Move Compar*er)' to determine what 1o explain to the 
e'tudent. f ' If it decides to give, advice to the student, it will call 
upon the English routines .to explain certain of the results of the 
Expert. The English routines ojss the Student flodel to prune .their 
explanafions i^ I i^t of the player's current knowledge. The Uumpus 
Executive coorjjina'tes the activities of the Uumpus Advisor and Uumpus 
game and imp^lementf the corteeptual model of a tutor shown in Figure 1.1. 



Not* that within ffits paper, **Student flodel" will be used to refer to 
more th'^ just the data about the student, but also the routines which 
waintai^n and evaluate the data. In effect, the Student riorfel ie a "black 
box* uif)\ch answers queries about the stu^Jsnt's currsnt staVa, and we will 
not be 'concerned apout'the detailsof its functioning until later. ^ 

'^''^ Burton and Broian (1975) deal^bes a previous Advisoh program for the 
game of Uest which ^was bui 1 1 V^rjidTnd an Expert and which utilized a 
primiti-ve Student llodel . 
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^ A« tht ^unpur* Expert perfome its cdiculat iontf, it. Keeps a record 
of the ' processes it went through to* arrive at its reeults. The 
inforMtion relevant to each cave is kept on the cave's property list so 

^that the infornation ie eaetly accessible. Tags are ileo put on the 
property liete which correspond to the unique nuebers aseigned to each of 
the rulee lieted in figure 2.2 and Figur^ 3.5. In this manner the Exper^ 

j>rovides a complete set of sub-conclusions anc: sub-reeults along uith the 
final results* « These property lists are used SKtensivsly by the English 
Generator, and Hove Comparer. Both of these moduiss contain a structure 
Modelling that of the Expert. 

Figure 4.1 
Diagram of Vusof H 
Arroms Represent Data * * 
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The Uuapus Advisor also has thf abi I Ky to modify the llumpue game 
to create situations mon% conducive, to learning. This has been done 
priearily by allowing the Kuupus Advisor to define the number of. bats, 
pits, I4u»pii,, and caves appropriate ly ' as wel,J as choosing the initial 
caves encountered by the student. The starting cave ts selected by the 
A^Jvi-eor, and the player's first wove is transposed to the desired cav^ 
(all of the choices for the first nove are isomorphic). This^ prevents 
the play^ froa losing on the first move, before he has sufficient 
inforication to make intelligent decisions anrf also allows the^ Uumpus 
Advisor to challenge the student witf^ simple idea4i2ed problems that are 
appropriate for 3 student of his level. Exaeples of proETiws seleqged 
for students o^ * dj f fer i ng levels are shown in the Appendices. As a 
further addition, the Uumpus Advisor icould be given the ability to 
restructure the warren as the game progresses. This modification i^ non- 
trivial since these changes muet bei transparent to the player, but, more 
impo-^tant ly, the Uumpus Advisor must be able to fully describe tHe 
eituation it is trying to create. "The current Uumpus-^ Adv i sor does not 
have sufficient information avai labile*' to it to allow it to fully speciiy 
more complicated situations, but i J. could attempt to move dangers so 
that," if , the student were playing wisely, he would gam posit iv^e 
reinforcement'. Conversely, If ihe player were pl^iying unwisely, nega^tive 
reinforcement Mould be supplied. - ^ 

la the remainder of .this chapter we will discuss the curriculum of 
.the Uumpus Advisor. ^ the next chapter, we will full-y describe^ the 
Student flojciel and ite riilationship to the tlove Comparer and the 
Psychologist. 'ThAn in Chapter 6 we will discuss the tutoring strategies 
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uh\ch hav0 bMn telectad for Uusor IK In Chapttr 7 we will deepr^ibe the 
English G#n«r«tor btfort ue discutt (in Chapttr 8) the txptr iM^enTTtlqn 
Mhichii appropriate, for the Uuepus Advisor. 
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^ Tht Curriculum \ 

Tftere iii a definita hierarchy for the different rules used by the 
Expert, which make^ it logical to have a correeponding hierarchy in the 
curriculu* of the Uuapue Advisor, It is not, real istic to explain^ the 
different probabilrty rul« until the student has mastered some the 
logical rules used in the derivation of the cave-eets because* the 
probability rules are so dependent on, these cave-sets. Because orf such 
dependencies, the curriculum of the Uunpus Advisor has, been broken down 
into five phases.''''^ In each phase, the Wu«pus Advisor attempts to 
teach certain rules, and the student ui I i not be advanced to. the next 
phase until he has Bastered /those rules which are the foundations for the 
nsKt phase. In the zeroth phase, the student is taught the basic rules 
of the game. In particular, fh-? player is taught that he is allowed to 
backtrack, '^'^^ and that, if a cave neighbors on a cave in which there 
were no warnings, that cave is necessarily safe.. In phases one through 
four, the pl-ayer is allewed to advance separately with respect to each 

danger and each danger has its own curriculua. This is necessary because 

j 

^he compleKity of the different rules varies widely according to* the 

distance through which warnings propagate. For this reason, there are 

Ik 

ti^ basic curriguluasi a curriculu» for when warnings propagate one cave 
and a curriculura for when warnings phopagate further, ' 



BIP,, (Barr, Beard, and Atkinsoh, 1975) a CAI progra» for t^eaching 
elementary proQramming skill's, has considered the issue of the conceptual 
dependencies * between the skills which are taught, BIP takes the more 
general approach of formelly stating these dependencies in an Information 
Network, This task is performed implicitly in the phases of the Uumpue^ 
Afbvisor, along with various other functions. 

^'^^ Knowledge of backtracking is essential for good play, and some new 
pleyere do not grasp it on their own/ 
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Y 

^ Th0 'curricuiuNis for bat9 aod pi t8, prasuiies a uaming distance of 

one cave. In the first phase of this curriculvimt the player is taught 

hou to perceive uhich caves are safs from the absence of a uarning. He 

Auet Master these rules before he can advance to phase tuo uhere he is 

taught the first probabi I i ty rule (Pll). The player must master this 

probability rule and^its supporting logical rules before he can advance 

to phase three. In phase three, the player is taught the reasonably. 

complicated probability ruled (P12 and P13) and must master both of them 

« 

before he can advance to the last' pha^e^ In the* last phaee, the player 

is taught the most advanced of the .probabi I i ty rules' (P14). This rt/1e is 

left to the last as it has a conceptual dependence on. the tuo preceding 

rules. All of the rule3 taught in each phase are shoun in^igure 4.2 

along uitti the necessary conditions for advancsment to the nex^ phase. ^ 
(v) ' . 



/ 

'^^^ In Figu/e 4.2, there is a new rule, T19, in th^^irst phase* of the 
Uumpus curriculum. This rule is a specialization of the logical rule L5. 

• It is relevant whenever a "Hore Than" classification involves N 
applications of rule L5 whe|^ N is the warning distance. It is nece^s^ry 
in cases where the warning distance is greater than one because in these 

^ cases students will eometimes not apply L5 to ths limic, ^ 
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RulM tMgh^ In tach phatt* 
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' The Utuepus currtculum presunes a uarning distance^ bf Kiore than one 
cave. In the firtt/phase of the Uu^pus curricuiue, the player is taught 
the logical rules necessary for perceiving uhich caves are safe from the 
Uuoipus* This phase has the saae, rules as in the bat/^it curriculum, but 
because of the increased uarning^di stance, the rules are more complicated 
'*to dpply. In the second phase, the Uuepus Advisor td'aches the player 
those rules necessary to arrive a4 cave-sets. This separation of the 
rules for deriving cave-sets froe. the first probabi I i ty rule is made 
possible becauee of the special value assigned to cavei uhich are likely 
to give inforeation about the Uunpui. The Advieor can ipeak of the value 
of coap I et ing . cave-sets uithout 'actually getting Involved uith the 
details of probability. Ths-ssparat ion of the logical rgles used in th^ 
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derivation of cave*Mts fron 'the probability rults it neceraary because 
of tha aKtra coaplaKity of a yarning dittanca of tuo cavat. This not 

only aifl^es tha logical rules aora coaplicatad, but also nrakes the 

I 

probability rula -Pll nora coapl icatsd as it nou involvas astiaates for 
tha ^aiza of tha cave-iet. In ths third phasa, tha playar is taught Pll 
and P15« Ha auat have aasterad Pll bff pre hs can go on to tha fourth and 
final phase. In the last phase the Uuapus Advisor attempts to teach the 
P12 and P13. This is not ^^^i bis in the standard gaaa as there is only 
one Uuapds and thers are no situations to deaonitrate these rules. As a 
result, the Uunpus Advisor changes the gaae sd that there are tuO/Uumpii 

in the uarren ae soon as the student advances to the last phase. 

V 

The player* is allowed to advance independently through the last 
four 'phases of, each dangart This allows for the possibility that the 
flayer ntght^^^^^^rn the uss of a rule uith respect to one danger, but 
night not recognize that it also applies to another danger. Houever, 
once tNe player has mastered a feu of the logical rules .for bats and 
pit's, it can be expected that he urPII recognize their correspondence for 
other rules. (vii) p^p ^^jg reason, there is a.functron in the Student 
Learning llodal uhich notes Mhsn the player has leai^^ned several 
corresponding ruiss for bats and pits; thersafter, it presumes that the 
player Mill recognize the corcsspondence between any other rules for bats 
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(v'^^Note that aince there is only one Uumpus for the earlier phases, the 
logical rUle Mhich considers ^the number of dangers (L18) becomes nruch 
simpler and is taught in the same phase uith Pll. 

^^'*^*This statement is based upon the playsrs uhich the author has 
observed. The author has ^observed fifteen or so studente in .their 
interactione uith Uusort in all cas^s the students quickly learned the 
correspondence betueen applicable bat/and pit rules. Houever, this issue 
uarrante further e^er imentat ion. 
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and pits and adjusts the familiarity Valuas accordingiy. The player is 
taugh-t the combinatitn rules (rules C8^ thru C7) independently of the 
different phases. However, in teaching the Combination i7{iles, the Uutupus 
Advisor takes into considsration the conceptual de;/endencies of the 
rules. 

The curriculuR that is taught by the Uu»pus Advisor is designed to 
first teach the student the basic rules and then the more complicated 
applications of these rules. Ths total knouisdge is broken doun into 
specific items, and t^ese i terns are grpuped into phases so that each 
phase has app I i cat ions that can be taught directly. This allouis the 
Uumpus Advisor to make short but meaningful eKplanations to thol^student 
at al I t imes. 



/ 
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Thm Pmyoholagimt and Student Model 
^Chapter* S 

4ji 0¥%r9i§m of th% Nova Compunr. fiyck9l0§Ut.^U9i4 Stuctont Mocftf^ 
Tho^ Studont tlodol along with tha Hova Coaparar and Ptuchologist 
hava tha purppsa of de t ar mi ninjg just uhat aovat can ba axplainad to the 
atudant and of dataraining uhat rulas can ba prunad froli tha axplanations 
to ba givan. Thasa tuo goals raquira that tha Studant Hodarba able to 
^tftaraina uhich rulat ara knoun to 'tha^ studant* »If a hunian tutor uere 
facad' ufth such a pr ob I a», his Studant HodaL uould ba.basad on several 
aourcas of inforaation. This sort of ganaralMzad Studant Hodal is shoun 
in Figure 5.1. Tha dacision of uhathar or not tha studant knous a 
particular rule ia based on the follouing inputs'. ^ 

1. Hdu of tan the stpdant seaas tp hava applied tha rula.. 

2. Hou of tan the studant has had the rula explained to hia. 

3. The student's knowledge of other rular (upon which this rule 
depends) • 

Cons i dara t i on auat also ba given to other iaportint points* They 3re: 

4. Hou quickly the studant learns* 

5* Tha student's initial knouladga of the rulas* 

6* The tina pariod that has elapsad and hou forgetful fha. stud'ent 
is. . ^ ^ 

« ■* 

Of course, these are not tha only things considered by a human tutor but 
thay are cartainly vary important cons i dara t ions* Our Studant ModerMill 
taka «!! of these inputs into considarat ion. 
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Apparent Application 
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In Figure 5*2 there is a diagram of the data flou betueen the Hove 
Tompar^r, Psychologiit, and Student^ flodal aa wall aa tha various sub* 
modutee of the Stuc^nt riodet* The Hove Conparer takes ang tuo movps and 
determines uhich rules ar6 necessary to justify their relative merits 



with respect to a single danger 



(i) 



It also queries the Student Hodel to 



^ determine whether or <u^^these rules are knoun to the student, acceptable 
for teaching, etc*. The Psychologist uses the results of the Hove 
Comparer according to the Combination Rules to determine if the student 
hae demonetrated a uorking knouledge of any danger-spec^J f ic rules uhi le 
the Uumpus Advisor uses them accord ir^^ to the Combination Rules to 
determine which of the Expert's results \i ui I I explain to the user. The 
loop in Figure S.l representing the student's Knowlsdge of other rules is 
implemented through the loop from the Learning Hobel to the tlove Comparer 
to the Psychologist to the Knowledge Model and back to the Learning 
HodeL The Student .Knouledge tlcxlel maiotalna Famniarlty VaTuiis uhich 
ret>reaent the atudent'a familiarity with any given rule. The Student 
Learning Model uses i,ts estimate of tha student's learning abifity, to 
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In Appendix C there is a complete description of hou the Hove 
Comparer functions. 
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int«rpr»t *th« Familiarity VmIms and ctot^riiin* Mhich rulM %M pldy.er is 
pTMuli^d to know.' ^'^^ Ulth th«M rulM't tht Student Learning Model can. 
imploMent the ^Mrr i cut um of the Uuepue Advisor by computing uhich routes 
are acceptable for teaching. Finally, the Student Model Critic analyze? 
the /inter^ll^ione be^een the Psychologist and the Learning Mpdet and 



adjusts the Learning Model as approprrate. 



(iiil 



Fiaure 5.2 , \' 
Arroms Mpr^s^nt ffjvte 
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In tM4 Chapter there ui 1 1 be ftiang references to the student's 
knowledge of the different rules. This ulll nor»allg refer to the 
Student Learnihg^rioder s estimate of the skudent*s Knowledge. 

^^^'^ The Student Modal also m^ntalns disc files on all of the users. 
These files ^re Ksged on the students f irst «and Jast 'name; any time a 
neu plagerj^uses the U'unpus Advisor, a new file is created. It' is, copied 
ont^. disc at the ^^nd of each session,^ and his flle4HB reloaded at the 
et^rt of A new eession. ° The^fils coht|i)ns the variables and arrays of 
the Student Knowledge and Learning' flo^ Is* as wellies Various e.ov her 
inforaation, - • - 
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PsyehologUt and Combination RuUs 
The ^6jchologt8t bagine its analuois'^han the player aeka to visit 
a cave in the fringe area and it aasunee thrat, if the player has 

OBO^ed to a cave uhich is (listant from the starting cave, he must ha^e 
di ecerned th)9t something uas urong u1 th those moves uhich uere c I Oder tjo 
the starting cave, The^ssu»pt iT)n that the player recognized a fauilt 



uith each ol the ulorse moves is qualified by considering the route uhlch 
the>^^^^4^yer took to his move. If the route taken uas .non-opt imat, the 
Psychologist M consider only those caves uhich uere very close io the 
stacking c^ve. ^^'^ If the player takes a particularly lengthy route» the 
Psychologist ui I I consider only the, immediate neighbors of the starting 
cave, ^viiK Likewise, if the Uumpus Advisor has recently advised 'the 

r 

player- to go to the move uhich.-he Tinal ly selected, the Psycholpglst ui I I 
not consi^der his move as it can not be certain just hOM much of the 



' ^'^^ The fringe area contains those caves which the player has not 
visited, and uhich are accessible to the player through caves Mhicff»he has 
already visited, ^ , . ^ 

The starting cave is the last fringe cave uhich the player visited or 
fhe last cave at which the player shot an arrow or received advice frjpm 
the Uumpus Advisor. 

The Uumpus Advisor ha^f^everal features which are intended to aid ^ 
the player during the game^ One of these is a routs planner which ui 1.1 
explain an optimal route to any cave that is accessible through visited 
caves. If the player uses this feature to find a route to a cave and 
then goes there directly, the Psychologilt wfll presume that the pfdyer 
recognized some fault in a77 caves which were wprse lhan the selected 
move. f . ' • 

Random chance becomes very likely when the player takes an 
/extremely indirect royte. Therefore, the Psychologist only considers 
"caves that are within N cavel of the starting cave where N-20-L-U L is 

the length of the route actually taken by V^e^player, 0 ie the length of 

the optimal route, and N has a minimum value of one. 



♦ 
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•dvic« th« playtr actual I y undarttoodt tviii) 

Pratuaing. that thara Mara uoraa^jievaa for tha Paychologist to 

conaidar* it uould dataraina if tha plagar ha^ daionatratad a uork'tng 

knouladga of any rulas. Tha Psycho I ogi at uould c6ncluda that the player 

haa daaionatratad a uorking knowladga of a groi^) of rui^s uith respect to 

a certain danger only if there uere no other plausible explanation for 

why the plpyer*e aove uas the better aove* Theee conclusions are based 

on a reatrictiva definition of the firet four Combination Rules. There 

are axanplea of this in Figure 5.3. In Figure 5«3A9 the last fringe cave 

visited by the player uas cave 5. The player then aoved- direct I y «to c^ve 

12. Cava 6 ia a uorse move J>ecauae it riaka pita and the Uumpue. 

Houever^ in this case the Psychologist Voii Id do nothing as it is not 

clear uhether the player perceived the danger from pite and/pr the danger 

from the Uumpue. The player aleo bypassed cave 3« a cava that was unsafe 

for bats, but« in this case, the Peychologist would presume that the- 

player had perceived that cave 3 uas unsafe (the default) and that cave 

12 uaa eafe from bate* It upuld note that tha player had demonstrated a 

uorkinf knowledge of those rules which made cav^e 12 eafe from batd. 

(Logical Rules L3 and L5 for b^ and Combination Rule C8K In Figure 

5.3B, the player started at cave 18 and chose the better move« cave 14, 

bypaaaing cava 17. Ifi XW\n case, there was a common danger from bats and 

a leeeer riek from pits. The Psychologist would aaeume that the player 

e'aw thafthare was a smaller riek from pite in cava 14 becauae cherewas 
a 

absolutely no difference in bats for tha player to perceive. It^woulcj 



^viii) Correepondingly, the Peychologist will not consider worse eioves 
uhich the Advieor had previouely informed «the plj[y»r were badr 
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Vote;-that the' player had denonetr^ed a working Knowl^idge of the rules 
necessary to explain both caves' probabilities for\)its. (Logical *Rules 
L1..L4. 4nd L7 Jbr pita. Probabilltu RuIm PU and P12 for pits, and 
CoBbi nation RuJa C3) . • » 

Figure S«3s 
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The Uumous Ad^sofalso 
bU^ it usss^a less^estric 
Uhile tKe Uumpus Advisor will 
of a single danger#it is, 
reaLSons other than vtose expl 
6 in Figure 5.3A, ^e Uumpus 
instead because offa smaller 
Mould only cursor! A mer^tlorv 
l^i'te at all because it tries 



implements th)l dliferent Combination Rules, 
tive definition of the Combination Rules. 
I only explain why a move is better because 
acceptable for thb move, to be better for 
ained. If the player aeked to move to cave 
Advisor would advise him to movs to cave 12 

risk from the Uumpus. The Uumpus Advisor 
the smallsr danger from pite if it mentioned 
to keep Its explen^tions short* 
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SoaetiMt • player mHI Mkji • lucky Mvt uhich gives the 
•ppeirance of • Mttery of pertain r'ulee but ^Uiich does not realfy 
indicate a knowledge of iaid ruleit To reatrlct this pdselbility, the 
Peychologiat fjret checks to insure that the rulee in queetion are not 
^el I above the expected levll of the etudent.^^^ If they are, the 
Peuchologiet uill consider his aove a lucky eove* Ae a further 
precautJ'eci^ the Peycho legist coepares the aove selected by the player 
uith a! I the bcTtter aovss avai labia to hia. If there are any eoves uhich 
are better than the selected aove and uhich the ueer ehould have knoun 
uere better, the Peychologiat uill degrade the Student Knouledge node! 
appropriately* The Psychologist deteraines if the student should have 
recognized the better aov« b^ ineuring that the novo in^^^x^stion uas 
better than or eKactly the eaae ae the eelected aOve In every way. It 
then ineuree that the student use thought to koou all thoss rules unich 
indicated the quality of the better aove, and, if eo, it uill degrade the 
appropriate ru4ee ot the Student Knouledge FlodeL In eoae cases* this 
degrading of the Student Knouledge Hodel uill cause the S'tudent Learning 
Hodel to' decitfe that the player dpee not actually know the rule(s) in 
queet i oni. and it uill move the player to ae lou a phaee ae neceasary. 




ft 



Rulee are cbnsidered to be above the expected levei of the etudent if 
they are not rulee uhich are cone idered aceeptabit for teaching. 
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' fAe V'-mpus Advisor * • The Student Model 

' * ' *' 

The Student Learning Hodel 

Just as the Student Knouledge flodel can be vieued as an overlay of 
the rules^ (and khoul^ge) of the Expert, the Student Learning flodel is an 
overlay of those tutoring capabilities possessed by * the Advisor. It is 
composed of ' those abilities uhich are deeaied appropriate for each 
studw4r'^'^ In Goldstein's Coach proposal (1377), an Advisor is 
envisioned capable of different explanatory strategies so that the 
Learning Model contains those explanatory strategies uhich are 
appropriate for' the particular studenti Houevsr, the Uumpus Advisor does 
not have this degree of freedom (as it has only one explanatory 
strategy) ' ^ , and the Learning flpdeh is pr inar i ly concerned uith a 
vector i^ich represents each student's learning ability in the three 
dimensional Learning Space. The first diiisnsion of the Learning Space is 
how long it takes the student to learn sontething (the Repetition Factor"^ 
and the next dimension i^ hou long it takes htai to forget something (the 
forgetful ness Factor). The Recepti\/ity Factor is the last dimension and 
indicates hou often the student likes to be spoken to. Hou often the 
Advi sor gives the student advice depends on the student* s Recepti\/ity 
Factor* There is a large region uithin the three dimensi.onal Learning 
Spftce in which the Uuinpus Advisor can function effectively. 

The first di»ension of the student's learning ability^ (the 
Repetition Factor) is a variable which deteruines hou high a Familiarity 
Value the student must have before it can.be presuned that' he kndus a 



'^'^ Overlay modelling^ is discussed more fully in Carr & Goldstein 
(1977). 

(Kii) Later versiqps of the Uuapus Advjsor will have expanded' 

explanatory abilities witK a correspondingly increased Learning Model. 
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rul«« Tht FuiniMrlty V«7u« for a ruU Is incraaanttd for one of tuo 
rMtont. ff tht ii^lagtr it not deea4d to have /itartf or the rule in 

queat ion,4 then the PMnidrlty V§Tu% ui 1 1 be increaented uhen the player 
ie told the rule in question. ' LiKeuiee, the Fuini^lty Value 
be increeented If the student deeonttratee a uorKing knouledge of the 
ruie Ian detereined by the Psycho I og i st) • (kIv) Uhenever the 
Famlli^lty VaTue exceeds the Aepetftlon Factor, the Student Learning 
node!; will presuee ^hat the e-tudent knows the rule in question, 
Uhen it notes that the student has learned a rule, it a rio^^cTiecl^^. to see 
if he has learned the rules requisits to advancing to the next phase. If 
so« the Student Learning Hodet will note that it is acceptable to teach 
the additional rules of the new phase. ^^^1) ^ 

The second disension of the student*s learning ability is the 
ForgatTulnass Factor. The Studsnt Lsarning Dodel noraal ly presumes that 
the student has forgotten certain of the aore recently acquired rul^s 
between sessions. This is done by decreaenting the- Familiarity Values 
according to the F^gatfulnass Factor and how long ths student has been 



(xiii) Uhether or no^ the player is deeaed to have heard of the rule in 
question is decided by coaparing the nuabsr of tiaes he has been told the 
rule with a variable that is dependent on his Repetition Factor. Note 
that this requires the Student Knouledge Hodel to' keep track of how often 
the player has been told a rule as well as his familiarity. 

^^^^^ Familiarity Values are a rather primitive implementation of the. 
Model in Figure 5*1 as the two external iftputs are combined linearly. 

It is worth noting that the test value for having heafd of rules is 
such that it is not possible for the Student Learning Model to presume 
that the player knows a rule without ths player having demonstrated a 
working knowledge of the rule at Some tims. 

(xvi) Ey0p after the student is presumed to have mastered o ruie, the 
Familiarity Value is updated whenever ths student demonstrates a uorkmg 
Knowledge of the rule* 
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away froa the Uuwpus Advisor,' <«vii) j^e Familiarity Values are 
decremented by an anount equal^ to the log of the number of days that the 
player hae been ayay from the Mumpus Advisor jpiue one). The base of the 
iog ip the inveree of the Forgetrulniss Factor* 
^^^^^ The Student Model Critic 

The Student Model Critic analyzes the player's behavior whenever 
the player makes a nove uhich indicates a working knouledge of a r^ule 
uhich he ie not presumed to knou, and wAen he makes a move which he 
snould have recogni zed las better (these situations are identified by^ the 
Peycho logi 8t , of course). In stich cases the Critic uill often afdjust the 
student* e Repetition Factor or Forgettulness Factor, whichever is 
appropriate. Also, if the player follow^ the advice of the Uunipus 
Advisor, the Critic will increase his Racept1v1ty Factor* In contrast, 
if the player ignor^s^^the advice o^ the Advisor and makes moves which the 
Advisor has noted as lad, Ihe Critic will decrease the prayer's 
ReceptUlty Factor, (xviy) 'These saiall incremental changes to the key, 
variablee of the Student Learning Flodel are intended to adjust the 
Learning Model to the Actual student's learning ability. 

The Student Model Critic makes an analysis of the situation before 
making any changes to the Forgetfulnass Factor or Repetition Factor. ^ Its 
analyeis is guided by the six Critic rules ehown in Figure 5.4. The 
Critic first notes whether or not --tine' pi ay er ie a new player; in such 



(xvii) ji^^ values representing ho/l^often the player has been to id each 
rcila are aleo decremented as his memory of the advice given i*e presumed 
to have decreased over the given time period. 

(Kviii) amount which the Critic increases or decreaees the student's 
receptivity depende on how recently the advice was given. 
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caMt, it it quite lii^tly that tha initial attiaata of the student's 
knowladga uae incorractt and ao the Critic uill onig aake iaieediate 
adjuataents ta the Knowledge ttodeh Thie is foraally stated in the ^irst 
two Critic rules of Figure ^5. 4, the Critic wiir preeuaa that it has ao^ 
acceptable approxiaation in the Knowledge riodel when it has to undo a 
daci'eion aada earlier. For exaapla, if the Critic repeatedly decreased 
ite astiaation of thavAludenf s Knowledge, it would stop a6]uy^1yg Xhe^ 
Knowledge Hodel as soon as the player learned a rule which he had 
previpuely daaonstrated that he did not ' know, '^'^^ This is formally 
stated as the third Critic rule. Once the Critic feels that the 
Knowledge Hodel has been adequately arfjusted, it wilt begin adjusting the 
k^p^tition Factor and ForggtruTn^ss Factor. However, the Advisor will not 
Make anu/changes to the Factors ff tne student's FaclU^rlty Value for a 
rule \^ quest jon is not re.ativel{^ doss to the Kai>atition Factor, If it 
le not fairly close, it is far eore likeig th4t this case is' rot 
indicari^cf^of the student's learning ability, but^*"^ i nsteaij,. a fluke 
Mistake on the part of the player or a lucky aoveh 

Once it is determined that the aove in* ||ue^on involves a ru e 
with a. Marginal Familiarity i/a7ua, the Critic will' aake the adjustment 
which is indicated by the last two Critic rules. 



(xix) Because- game situations often allow the student to more quickly 
demonstrate a knowledge (or tne lack thereof) cf rules with rsspect to 
certain dangers, the Critic notes whether or not the Knowledge hodel has 
been adjusted with respect to each danger. 

^^^^ Tha^ Critic will not make any changes to the Learning Model if the 
Familiarity Valua was set 'in the initialization period. 

Page 42 



4 



Th9 Vumpus Aifisor - fAe Student Model 
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CBl if a new player demonttratet a working knowladga of a rule which 
he was not initially presumed to know, adjust the Femniarity 
Value to indicate a knowledge of said rule. 

CR2 If a new player indicates that he does not knotT a rule which he 
wasyinit iai ly presumed to knoM, adjust the Famniarlty Value to 
indicate th^t he does not rcalfy know eaid rule. 

CR3 Cease adjusting the ini t iai izai,t ions of the Familiarity Values as 
soon as some decision *«ade^ according to CRl or CR2 is 
contradicted. 

CM If the player demonstrates a working knowledge of a ^ule which he 
was not presumed to know, then 

k Decrease the player's Forgetfulness Factor if this was a 
rule which he was presgioeci to have forgotten recently. 

f B Otherwise, decrease the playerU Repetition Factor. 

CR6 If the-player's actions indicate that he does not really know a 
r^jle which he was presyeed to know, then 

A Increase the Forgetfulness Factor^ f this was a rule 
which the player was presufted to have learned in a 
previous session. 

^ Otherwise, increase ',he player's RepetJ^ienJ^ctor. 



In this manner, the Student Model Critic adjusts the values of the 
Student Learning no<Jel as appropriate. 

The Student tlodel Critic also identifies those situations in which 
the I i site of the- Uumpus Advisor are exceeded and a human teacher is 
neceseary. This is done by noting when the player does not seem to 
advancing after an extended period and, more importantly, by noting those 
situattona in. which the limitations of the Uumpus Advisor are exceeded. 
For example, within a two dlnensional Learning Space composed of the 
Repetition Factor and the Forgetfulness Factor, the Uumpus Advisor is 
1^ 



(xxi/ ^y\\b point it should have^become clear to the reader that the 
Student Model keepS' trac^ of when a player is presumed to have 
Iearn%d7unlearned each rule, which Vules were forgotten, etc.. 
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cottp#t«nt at •dvieing •tudantt Mithin th« atM •Homh graphically in^ 
Flgura 5. 6. Tha Studant Laarning riodal can rapraaant a uaar as a ^ecXorr 
•nywhara wi thirT'^h^-^aarkad araaJ^^''^ Any t iaa tha ftudanf a Learning 
Vactor falla outaida^of thia ragion, tha Sttid«nt Hodal Critic CaMe for 
KuMn halp aa tha liaita of tha Uuapua Adviaor Mill hava baan axcaeded. 

FlfuriS.! 




Advisor can not aluays keep up with extreaialg qui^ students, but the 
Advisor is not rsal ly necessary in such cases. However, the li»itation of 
tha PorgetrulnBSS Factor say be very *^signi fi cant, as the Uujipus Advisor 
can not deal effectively with fludents who are aKtra»ely forgeytul. The 
lisitation is cauaad by the fact that tha UUispua Adviaor keeps track of 
tisa in days, which could be too large a unit of aeasure in^eKTreme 
cases. Further testing ie required to detersine if this is an acceptable* 
;i«itation. Otherwisa^- i t would be necessary to aodify the Uumpus 
Adviaor to keep track of tiiae in hours or, poaaibly, ainutss. 

(xKii) rsa3sr should note that the Uuepus Advisor is not able to 

finely tune ita advice for playara whoai vaetora ara cloae to the limits 
of the Uuapua Adviaor* a abiiitiaa. 
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It is eetential^ t))at the Student nodal have the abi 1 1 tg to 
recognize ite own lieitatione, Froe dbeerving various students and their 
: ntaractione with the Uunpus Advisor, the author has noted that one very 
inportaht etep In the etudent*e learning Is the development of a good 
rapresentat i on for inforroat ion about the warren, Ui thout. a_ goad 
representation, it does not seem to be possible to advance to the more 
advanced phases* In all cases, the atudcfnts have eventua'lly developed a 
good representation on their own (the Uu«pus Advi'^r does not currently 
have the ability to teach' good ways to draw warrens). However, it is 
likely that eo»e students would not overcome this obstacle on their own. 
U^We it rs simple to add in the ability to graphically display "good 
warrens" to the student, this is almost certaiMy" only one of ,many 
possible pitfaNs for the student that the Uumpus Advisor would not be 
able to deal wifh. In such cases, it is essential that, the Uumpus 
Advisor have the ability to 'monitor itself and determine when something 
has gone awry. 

The Initializations 

The Student Hodel is init'^lized according to information elicited 
froai the ueer.^ Uhenever a user starts up Uusor and the Uumpus Advisor 
doee not already Have a file on disc about him, the Advieor will ask the 
new user a eeries of questions which are ueed to initialize the Student 

Model. Firet, the Uumpus Advisor will ask the student 1) how old he is. 

• • 
2) how many years of education he has completed, and his general attitude 

to riath/Sciencee. Uith this information, the' Advisor will calculate the 

etudent'e Repetition Factor and Forgetfulness'Factor under the assumption 

that older> better educated students who enjoy the Math/Sciences are 
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b«tt«r pr«p«rtd to learn about tha Uuapua doMln* Onct the Student 

Laarning nodal haa baan calculatad tha Advtaor will aak tha atudant' hou 

■any gaaaa of Uu»pua (if any) ha haa playad* Thla u) 1 1 ba combined with 

' f 

uhathar . or not tha atudant chose to raad tha inatructiona and his 
•atiMtad laarning ability tovaatact ona of tha four poaaibia starting 
9tataa for tha Student Knowledge flodaU Fro» aicper iaantation it has been 
found that the Advieor advancae the Student Model Mora quickly and 
accurately than it degrades the,Studant Hodar (as increasing knowledge of 
the ga»e ie ooraal), and so the initial et^te^of the Knowledge Flpdel is 
ger^erally a coneervat ive 'estii;;ats» In this aannstr the Student Modei is 
initialized to a state which is hoped to be close to the actual state of 
the etudent* In any case, it ie not of great iaportancs that the Student 
Model be initialized with extrene acburacy ae the Student Model has the 
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Tutor I ng Stnmteg i mm 
ChQpt^n 6 
Model of Tutor/Student Interactions ♦ t 
In Figure 6.1 there is ^odel of the interact! one between a tutor 
and a etudent. It. Is intended toemphaeize the cyclical natures of their 

communicat ione. The tutor com^^unicates hie^vftxplanat ions to the student 

s 

arid the student c^mrour^icates his understanding td* the tutor (feedback)- 

The tutor modifies hie instructions according to the feedi^ack and-will 

elicit feedback \i he is receiving insufficient feedback. Typically, the 

instructions are the explanations of -a teacher, while the feedback 

includes every-thirig from facial expi^^ess ions (boredom, non-comprehension, 

etc.) to test scQres. This model is lof a generalized tutor uhich could 

jDe a human instructor or a computer program, ^ 

Figure 6.1 
Model of Tutor/Student Interactions 



Tutor 



Instruction 



Feedback Elicitor 



Student 



Feedback 



There art severer linitatLons in the computer*s ability to 
communicate. Thie difference is primarily due tt> the fj^t that the 
^CDmputer*e communications are restricted 'to the domain of typed 
responses. The computer can not fely on facial expressions or verbal 
• ignale to emphasize key potntst ^AIsq, it can not use facial express ions 
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The " ir^etcuctions can havs varigu^ 'forms. These different 
^pproache)^: to teaching^Mn be laid out along a spectruol which represents. 
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^'y**-* •ourc'e of feedback. For example* it is inapprdpr iate-for a computer 
(urogram to use joKes as i feedback eMcitor bec^se jthe computer calll^not^ - 
^ — evaluate the response (laughter, sni^rig, etc.). ^ 

In general.! 'h &ompiit%r program must rely on more formal avenues of 
coaMuh i cAt i on for its' instructions, fesdback el ici tors,^ and aour^e^ of 
it faedback. < , . , -y"" \* ^ 

' Imtructiqn ■ , ^ ^ \^ 

the amount 'of thinking required of, the student., This* is ihown in Figure 
^•2* • A poir>t at ^he left end ^f the spectrum, indicates that the^utor 
einplu^ pf'Q^ants^ al'gorithms ^bout the domain. T^is approach requires 
little thought oh the'part of the student -And cart be highly .,ef feet i ve at < 
quick#ly giving the student mastery oi* the fie*d. ^^'^ The opoosite 
extreme ie to simply present the -problems to the studen^t state the 
so lulrt'ons. This requ^^s the ^student to workout a tecljnique for sV|p'/»ng 
the problems. Thi« process is generally v|ry slou and painstaking and 
^ , leaves open ihe possibility that the studenj witt^n#er master the given 
problem ctomain. However, once the student has mastered the domain yith 
the la^tter approach,'' he is very unlikely to forget the learned material 
and those lessons which the student learns in ^he given domain are more 



I ikel li tc^e.aiapl iec^ in other domains. 
4'' The idea qualifying the type of 



qualifying the type of teaching according .to the effort 
re2|MMred of ther* student* 1 s presented in Uin^ton (igy^).- 

Of course this di scussi on pr esume^ that the strategy selected'uill 
, be .developed in the *l?est means Dossil^. The approach on presenting 
algorithms to the student coulcf*be co»l i cate'd by u*1ng**very complex!' 
language," thereby requiring signi f icanJBef for t • of the student just ^to 
comprehend the tutor. This ie contrar^^o ^the intent of the al gor i thmip 
approach, and ue do. not consider such cases here.* 

% 
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Teaching 
Algoritms 



F'gure S.2 - 
5p9ctrum oJ.Jnstruetion Emphasis 

^ Explaining 
Excunples 



Giving 
Results 
I 



Algebra 
'Tutor 



A 

Wun5>us 
Advisor 



A 

Wumpus 
Game 



In developing the Uumpus Advieor* it uat dtcidtd thatMhe Uumpus 
Advi8Qr*8 instructions should be biased touard explaining results. This 
is shoun n the spectrum o^ Figure 6T2. The Uumpus game itself could be 
located at the* extreme end of the spectrum (as shoun in Figure 6.2) as it 
8imply^i4ppl the p lager uiUh results and the player is left on his oun 
^to develop better techniques for avoiding dangers. The disadvantage of 
the game uithout an Advisor is^ as stated ear Tier, that the player can 
reach^p lateaus in l^is deve to|^en¥^d not advance to higher leverl^. The 
Uumpus Advisor generates explanations uhich are intended to lead the 
student to the* accepted solutions. Uith this purpose, the most direct 
approach uould be to present the student uith aXsomeuhat -simplified 
version' of the a I gor i thms' u^ed^ bgAthe Expert, but this approach does not 



seeni to be conducive to teaching t^etter uays ^ think about problems. 

The author has tutored various stddents m the game of Uumpus, and, 

l^en he presented the, algorithms of the expert, the player-s quickly 

mastered the game, but there uere also no indicatrons that. these students 

^ ^ ^ 

developed any improved thfnking ^habi ts. Houever, uhen the author relied 

on the Uumpus Advisor and its explanations of the results (as opposed to 

the actual algorithm), he found that ^tt^^learning process varied. Those 

pTayers uho uere already logical ly oriented (such as fl. I .T. graduate 

/•'■•■■• 
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stuckints) quickly developed algorithms of their. oun. The playere'uho did 

not poeeejee the deeired thinking habite' (i.e. those who uei-'^ not. 

■arthenatical iy/scientif ical ly inclined) found the ideas presented 

intrjjjuing and rather difficult. They would put serious thought into the 

explanations and after many tries mastered the material. Comments uere/ 

aada such as "OA wow, this is^a compl9teJ,y n9W way of thinking but 

i 

"Rafter having mastered the material they found it difficult to accept that 
,tha jiaterial wae so difficult ri^ui its so^ obvious*") .^'^^^^ Because of 
e^^ ^tfvidisnce, the Uumpus Advispr generally does not striate its rules 
fOTAa/ly ^0 the student but rather gives explanations of the results. 

In, domains where the material to be. taught is thougnt to have more 
intrinsic vaKie {such;a8 Algebra which, it can' be argued, can be of. use 
in every day choree such as balancing checkbooks), there is a^bett^r. 
^ justification for teaching with a more algorithmic approach. A computer 
tutpr for-Algebra might factor several problems, showing all the steps to 
tba student. Than it could give the stpdent various problems to do on 
his own to help him (^emember the algorithms presented. This form of 
instruction is appropriate in those domains whers the subjsct matter has 
Intrinsic valus (rather than helping to develop improved -thinking 
habits), t'^') . . • . . ^ 

" FteUback . . 

It is also possibls.to lay out the different approaches to feedback 



ERIC 



^'^l^ The above observations were made with about fifteen students in 
sspardtd sessions, each of which iastad.an average of three hours. AM 
results wire 'the subjective evaluations of the author^ 

^'^^ Socrati^c instruction (throughr Isading quesx'ons) can be viewetK as 
another approach to -Hhe problem of non-aigori thmic tutoring strategies. 
Socratic questlon'^ng is discussed fuMy \i\ Collins. 

' » 
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along a spectrunu Such a spkct/uIlN^^ in figure 6*3. The points at 

the l^i^^enS of. J^he spectrum l^for tutone which aek the student direct 
queet tone' about the subject natter'^The' poipt at the right end indicates 
that the tutor .est imates the student* sXipui edge soieiy by observing his 
behavior* An Algebra tutor uhich .pretenti p^l^ftms to the etud^nt and 
observes hou he solvec them, you Id be touard the middle 

Figure^B*3 

.] Kethads of Gaining Feedback 



Questions About 
Domain Knowledge 
I 



Giving Problems 
Requiring Knowledge 



Algebra 
Tutor 



Observing 
Behai/iour 

/ J 



Wuit5)us ^ 
Advisor 



The rethods used -by a tutpr to gather feedback are- largely 

c 

determined by the teaching environment and the subject matter that is 
being taught* The teaching environment restrict^^^e options availabie to 
the tutor so that many techniques, such as jokes, are not available to a 
computerized tptoc- Also, the subject matter lends itself to varioos^ 
feedback approaches. Geography is a field in uhich it ie very difficult 
to evaluate the student's retention of the material uithout directly 
asking questions concerning that knowledge,. , ' ^ ^ 

The Uumpus game is a domain uhich ie conducive to obtaining 
feedback by- observing the student's behavior." This is true of most games 
environments de the g«ie presents the student with problems to so I vet an 



A geography tutor would b& expectifd to esk questione euch as, "Uhat 
fs the ^capital of Brazil?^ ^ whicln Is a direct teeting^of *the knowledge 



that is being taught. Just such 
Carbonel i and Col I ins m SCHOLAR. 



ography tutor has been developed by 
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Advieoft nttd only observe the reeultei In euch environments, it is 
inportant that the Advisor be careful to ^teke full advantage of these 
observations and minimize the number of questions uhtch it asks of the 
student* If the Advisor does resoft to "testing" the student as a normal 
procedure, the etudent's enjoyment of the game is likely to be greatly 
diminiehed, and he is likely to resent the ministrations of the Advisory 
For theee reasons, the Uumpus Advisor relies almost solely on 
observations o1P the student for its evaluations of his knouledge of the 
game. ^^'^ The only uay in uhich the Uumpui Advisor can be said to be^ 
\)v eliciting feedback is the manner in uhidh it defines (and perhaps alters) 
the game in order to create environmejits uhich are more conducive to 
laarning and the evaluation of the student* 

The above tuo spectrums are, of course, simplifications, but they 
<halp to emphasize tuo very important issues of tutoring strategies. 
Other issues that must be considered (and uarrant further 
exper i ment^ i on) are such issues as graphical versus verbal explanations 
and the typee of instruction uhich are most effective (such as proof by 
contradiction, uhich is one the key methods of the Advisor for sin.ple 
proofs)* It i's expected that Uusor III ui I I be able to vary its tutoring 

strat<tgies according, to the student and uiii consider each of the above 

/ , - ' ^ 

issues as uell as other of sjjch issues* Thess additiotQs ui I L increase 

! • ^ 

liu8or*s Learning flodel - to the dimensions described in Golekstein's 

propoeal for the Coach Project (1377), •-'^ 

r 

^^'^ For the purpose of testing the validity of the Advisor's deductions, 
a useful experiment is to ask questions of the student to determine the ^ 
correctness of the Advisor*s estimation of his knouiedge* 
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In designing Uueor II, there uere 8evera4 possible approaches to 

#» <' 

the problems of presenting the oaterial and evaluating the student's 
response. The Advisor presents eKplanations of the results of the 
algorithmst instead of the algorithms themselves, as this seemed to be 
more conducive to. teaching better uays to think about problems, 
LIkeuise, it uas decided that 'the feedback frpm the student should be 
ga chere^ pr Imar i Lg by observing ^ji^pjtudents behavior as this would not 
detract from the students enjoyment of the game and uould help maintain a 



positivflL feeling on th§ part -of the^student toward tfte Advisor, 
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Chapten 7 ' * 

Th« English uMd by Vnm Uuapus Advitor !• g«n«rated in a 

cooMptMJIu clMT Mnhari For each of tha routlnaa/rulaa of the Expart, 

thara la a corraaponcting English routina/rula. If a routlna of tha Expert 

uaaa tha reeulta of a lower level routine, the correeponding English 

» 

routU^ will lik^lae insert the text generated bg the correeponding 
louer level Englieh routine into its text. "^'^ In this fashion, it is a 
quite sTnple to urite sh(#t functional English generation routines. The 
problea Mith such an arrangeaent is that the. Englieh theret>y generated 
taode to be rath^ long and aukuard. For this reason, various additions 

m 

Mara aade to the basic fraaauork just described to iaprove on the output 
of tha Englieh routines. In the reaainder of this chapter, ue Mill 
desbribe thoee additions uhich uere aade to this siaple approach, 

A vary iaportacHt addition to the English routines was to aake thee 
•Hare of uhat tha player already knows. In this fashion, ti<e English 
routines can oait. those porti^Fis^ of explanations which tha player ia 
thought t4 already know. This Is not ^Mtreaaly laportant in the ear Mar 
phasae of tha currlculua, but it becoaes aore laportant later on. As the 
UuBpus Advisor teaches progressively aore advanced rules, it relies 
increasingly on the stapler rules which havs already* been taught. If the 
Englieh routines do not oait tha lower level explanations, the 
•Hplenations bacoae quite long (and it becoaes extreaely unlikely that 



The approach of having the explanation routines bodel the decision 
Mking routines is fully described in Stansfietd ^^^^I* 
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if - - 

\ 

the student wilLread the explanation at all). The genera I , so I ut i on to 
this problen is to havs each' English Routine first check to see if the 
player already knous all of the rules involved in its explanation. If. 
so, then the English routine will not generate a complete explanation, 
Put will instead only summarize its results. This sieple check generally 
suffices to prune out the- unnecessary parts of the exp*^ ana t ions. 

Figure 7.1 ' 




Circled cayes have been \^1s1ted. 
Upper Case: Qlyen Pecte 
Lower Case: Deductions 



For exasple, a moderately advanced player was faced witK uarren 
shown in Figure 7.1 and he received the following explanation of why cave 
15 was ver^ likely to contain bats (P13). 

One of ce\/es 16 and 7 contains bats. Likewise, one of 
cayes ,5 and 15 contains bats, and one of ca^es 16, 15, and 9 
contalnsr bats. As you haye r^Hlple evidence for bats In caye 15, 
' It Is yery likely that caye 15 contains bats. 
This explanetion* presuRcd that the player already knew al.l the rules 
necessary to derive cave-sets, so that the explanation routines simply 
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lifted th« c«vf*Mtt cooc»rn«d ratlw than •Kpliining each one. However. 

onca th% student mo6ml uat »octifi*d to indicate no knowledge of the 

raquirad rulae» the following e)cplMtion uaa obtained: 

Ooa of ca^as 15 and 7 coatafM teta. Ca^e 29 m/it be' 
naxt to ^ta i>acai/aa m haar^ aouaaftfns fa care^9. Mfnce one o/ 
ca^ea id, 7, d, and 4 contains bats, but m ha}/a safaTy \/lsited 
eaya 4. Also, ca^e 8 can not contain bata bacauaa If bats ware in 
eaya $ m would haya haard squaaking In care 4 as care d Is naxt to 
eaya 4. This mans that one of carea id and 7 contains bats, 
Likawlsa, one of cartJ 5 and 15 contains bats, Cdra 0 must ba next 
ta bats because wa heard squeaking In care 0, Therafcre one of ' 
caraf 5, 15, 4, and 3 contains bats. Howeyar we haya safely 
ylsltad cayas 3 and 4, This mans that one of cayas 5 and 15 
contains bats, a/id one of cares id, id, and 9 contains bats. Cave 
2 must ba next to bats because we heard squeaking In cara 2, and so 
one of cayes 16, 15, 9, and 3 contains bats, 'but we haye sa^fely 
ylslted caye 3, This means th^t one of ceyes 16, 15, and 9 
contains bats. As you haye multiple eyidence rt>r bats In caye 15, 
It Is yery likely that caye 15 cpntelns bats, 

UuBpuH Advisor uouid never hava aade such an explanation under ^c^^^i 
circuaetancet but this axaepla does point out .the leportance of 

pruning the English for even aoderataly advanced eKpianat ions. Without 
pruning, explanations quickly becoae so long that the*^the overall thread 
of ^he explantttion is lost. 



Normally the Curriculum uould prevent the Advisor from explaining 
rule P13 before ths student* had thoroughly mastsrsd o* the ruies 

involved in explaining cave-s#^8, but for this example the CurricuTum yds 
diadbled. ^ 
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* Another problea with the very si»ple nodel of the English routines 
IS that such a Bodel does not consider the idiosyncracies of the Engfish 
language. For exaaipie, the English routines should not say ''one cave 
away froa** or *zero caves auay fros" (as was coanon in this paper), but 
rather-it should say 'next to" and "contains". There are a great many of 
sucHi special cases "^aost of w^iich center around the end conditions), and 
the English routines »ust have this knowledge progra»«ed into them\ Such 
problems can be handled with httle deviation fro» the conceptual model 
if they are handled aooularly. 

I n order to f i ne ly tune the* Engl i sh rout i nes 80 that its ou tpu t 
consistently sounds natural, each English routine should be written witH 
an idea of the context In which tt will be used. An example of ^his is 
the amount o* introduction given by an Engljsh routine for a lower level 
English rout ins' s sxplanation. If the lower level '^outine returns only a 
short summary, then only a shprt introduction (if any) is warranted. In 
contrast, if the lower le-vel routine returns a lengthy response, a lontjer 
introduction i s ' warranted, ar^d, in some cases, the entire explanation 
should^be restructured. Such issue% can be resolved rslatively easily by 
considering the curriculum, and the overall hierarchy of the rul«s; It 
is unreaUstic to presume that the English routines which explain cofr.pl ex 
probability rules will ever be cal led^ before the student has mastered the 
simpler probability rules. With this in mind, it is reasonably s^f.e for 
the more complex probability routines to. presume that the student will 
have thoroughly mastered cave-sets by' the time they are called. This 

\ 

Thm solution to the problem stated above is simply a routine that 
converts "N caves away from" into its English equivalent. 
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r%\\9nc% on th« etructurt of tho currlculM allout the corrtext 

Mntitivity to ti% otttic. ^ 

The addition of various chacKo to tha concaptual frameuork 

original ly' daacribad has changed uhat would have been very stmpie 
^ k 

routines into relatively long and coaplax routines. An alternative method 
of iaproving on the English generated by siaple routines is to use a 
etandard Englieh Generation Front End as shoun in Figurs 7.2. , The Front 
End uoutd accept ths relatively "rough" output of ths English Geqerator 
and then iaprove on i t by perforeing such tasks as pronoun insert ion, 
introduction eodi f ic^t ton« phrass rsplacsaent, etc*. This would have the 
effect of ieproving the overall quality of the fnglieh generated (as 
great effort hae gone into devslopi^ng such Front Ends) ^'^^ and would 
also sake the t^sk of generating Englieh siepler. (Less knowledge of the 
English language would have to be progrsMied into the Advisor's routines 
as that knowledge is already prograemd into the. Front End). 

Figure 7.2 

Diagram 0/ an inglUh Cefferatio4 SysUm 
4rroM Ae^rsisn Data 



Wmpus Expert 



laf ormation' 
Student Model 



tioa 



English 
Generatpr 


Rough 


Englieh 


» 

; Normal 
--1 ^ 


English 


Front End 


» English 

r 



For eore deta>Jsd information about English Generation Front Ends, 
eae the work of rteDo^aldi Novak, Sieiiionsi Schank, stc. 
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Test i ng the Advi son 
Chapter 8 

The Uumpue Adsrieor is currently being teeted to verify that is 
does, in fact, function as described* Also, a qreat many of the 
cb^cieions which were made during the xleeign of the Uumpus Advisor were 
based on the judgement of the author; these issues warrant further ^study 
determine if the approaches , taksn were correct. Finally, it is 
important to determine whether the Advisor succeeds in teaching better 
ways to play Uumpus and, more importantly, better ways to think acibut 
problems. The tests can be divided into two general classes. They are 
local tests designed to test ths ability of the Advisor^ to perform 
epecific -.unctions and global tests intended to test the overall ability 
of the Uumpus Advisor. , 
iocaZ Tests 

|.ocal tests have been made with two different approaches to the 
problem. The first was a series of ssssions' in which students used the 
Uunpue Advi>o>yir> the pretence of the author. In one such session, it 
was noted that negative logic (explaining th^ absence of warnings) was 
much more understandable than the approach then being used by the 
Advisor. Prior to this, the Uumpus Advisor would generate explanations 

y 

like; I • ' 

Cave o' cin^t CMtaIn th€ yumpus beceusa w$ did not ime77 the 
Vlumpus 1n cave^^fi T^s mans that cavB 2 is mor^^ than two cayes 
away from the yimpirr; caye 1 1s not next to the Vumpus, and cave » 
can not contain the Wumpus. 

This (positive lo^ic) seemed unnatural to students, and they responded 

. \ 
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Much better to the negative logic which it currently used by the U^mp\<s 

Advisor.. In the eeee eituatiorr, the Uuepue Advieor uould eKplaint, 

Cei^e 0 can not contain the Vumpus because, If the Uumpus were 
there, we would he\^e smeVeit the Wumpus In cai^e 2. 

There were apprOKieately ten euch eeeelone of roughly three hours^ 
duration, and, based' on subjective evaluations of the sessions, it Mas 
determined thai in genera T the Advisor 'furitct ioned as desired, but it uas 
not possible to determine hou uell the Uuepus Advisor uould function in 
the uide range of situations it uould eventually face. 

The next group of experiments to test the Uumpus Advisor* & abi li ty 

« 

to functior as planned uere conducted uith a Synthetic Student*''^ The 
Synthetic- Student (Syndi) uas designed to play* the game of Uumpus in 
conjunction ui^ the Uumpus Advisor (Uusor), Syndi ie a perturbation of 
the^^^pert of Uusor with the main' change bei,ng the addition of 
conditional etatements uhich allou Syndi to play with edme subset bf the 
full Expert. Syndi has a Knoufedge flodel of her own and her. Expert wiM^ 
not apply any rule unless the Knowledge Model indicates that she 
poesessee knowledge of s^id rule at that time. Using Syndi, a great deal 
of debugging of Uusor was-achieved wi^ relative ease* Uusor 'e anaigsis 



4iAh reiativ 



of the student'e move invo^lves several inherent assumptions and Syndi uas 

designed to t^st Uusor's analysis given that these assumptions are true. 

S 

The assumptions are: 

1. The student does not apply paradigms unknown to the Uumpus 
Advieor. 

2« Uhen faced with several equally desirable choices* for moves, ^ 
the player will choose^ that, move whi,ch is closest (and hence 
easiest to get to) . ^ 





The idea of i4sin{i a Synthetic Btudefnt to test an Advisor program uas 
orig.indlly deecribed in Goldstein's ^ach Proposal (1977). 
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3. The player is cpnsistent in hi'8 application of rules. He does ^ 
not have partial or incomplete under st and rng of a given rule' 
(the undesirabi I i ty ^of this assutsption is decreased by the 
almost atomic rules of the Expert).. 

4. The player does not make mistakes. Uusor*s relative cSutiqn is 
necessary because this assumotion is obivUuJSly^ false. 

5. /The player comprehends the expl anat/ioris given by Uusor. 

Syndi uas designed to satisfy all of the above assumptions. Also, as <^he 
had a distinctly diagnosable knowledge of the' game at all times,' it uas 
qui^e simple to verify any results obtained by the Advisor, Several 
experiments uere run with Suhdi ^nd Uusor, and they can be grouped into- 
three types; 

1. Experimerfts in uhich Uusor initially presumed Syndi had no^ 
knowledge of the game and Syndic played with a constant 
knowledge state. I.deally. ^usor should advance' his estimation 
^ * of Syn<^i*'S knowledge to exactly correspond to her acfual state 
and not beyond. . . ' , ^ « " ^ 

.2. ,Expe'*iments • in wh'ch Uusor initially presumed Syndi had a 
complete knowledge of the game and* Syndi played with a constant 
Knowledge 8*tate. Ideally, Uusor -should degrade his estimation 
of Syndi 's knowledge to agree with the actual state. 

«3. Experiments in which SyndK started as a new player with no 
i^nowledge of, the game, and "learned" rules, as Uusor explained 
them to her. Ideally, Syodi's knowledge should increase ,tp 
complete knowledge o*f the game with Uusor^ estimation lagging 
a iTttle behind each change.U / ' 

These experiments are relatively complete and thorough I y^ test the 

Adviiior's functigning given that the above assumptions are true. . In 

exper imentsp ^of Type' 1 (advancing to *3 fixed knowledge . state) , it 'is 

acceptable to always start with Uusor presuming Syndi has no knowledge of 

the game because Uusor must advance his estimation through a[l of the 

phaees up^ to""the desired phase to achieve the desired reeult. This also 

justifies starting all Type 2 jsfrper i ments (degrading to a fixed knowledge 



I 



Page 67 



yata) from an initial ^attjaation of compiata aaatary^of t^a gam^e. 
Expariaanta of thi flrgt two typat^ tapve to taat tha^xi stance, of 
altuationa which uill allou Uusor to naka daducttona an uallNae testing^ 
• tha corptctrtata of said daduct iong. , .Tha third typa of axperiment is 
nacaaaary to inaura ^at thara ara ai t^ationa^ which alloM Uusor to tutor 
a atudant froa tha vary batica to tha aoft advancad akilla in a moderate 
a.aount of tinia* " • 

Uhan conduct iTig the above experiments, jievepSI modifications were 
fotind neS^aary. flanu pf the e><periinenti uith Sundi did not achieve the 
deajre<} raaulte on ttteir first run, which required thpt Uusor be modified 
in IKght of the pre!i»inary results. Then tha prbcesa would be repeated. 
in this sectliorj, ue. will discuss the exper iajcnts which were run, the^ 
^probl««8 which aroae, the solutions* which were found ^f any), and th^ 
"final results achreved. All this will be In general terms with the 
^epecif ic reeulta achi^ed ehown in Appendix F. 

The firet axperiaentj *were run with Syribi hav'ing a complate 
knftuladge of the game and Uusor initi'ally presuming that B> ^had 
knowledge o-f the game. .It was found tifi^Uusor advanced the s^j^udent 
rapidly with respect to the Uumpus domain, but unreasonably 8lo^!y wi^th 
reapect to the bat/pit domain. Because of this, -several' modi f i eat i or s 
wara required before Uusor would correct' Its estimation of the stgderrt's 
knowledge to complete martery of tha game within a reasonable amount of 
'tim^, Tha firet problem was that Syndi would risk bats • far more 
^regularly than*p1ts (as bats are not necessar^*. ly fatal) ea that Uusor had. 
vary few chancee to |>bser>/e the applixation^of tha probability rul%d>with 
raspedt to ^i-ts. This required tha modification of ihe student rrtodeMing 
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components so that- the .bat/pi t Familiarity Melues uould be associated 

*, * 

together orlce' Uuscr had determ'ned, that the player had mastered the rules 
to 'determine uhich caves are safe (i»e* Uusor uould ^presume a 
transference of bat/pit knowled|a^onx:e the player had mastered Phase 1). 
The next modification uas required because there uere often lorjg periods 
in uh'ich theris ue>e no situations uhich uould allots Uusor to deduce a 
mastery df prodability rule PU for bats/pits. In order to overcome this 
difficulty, Ulusor uas given the ability to modify the initial game 
srituation to create 'ideal situations appropriate for a player of the 
given phase. These ideal — situations are described in Appendix C and 
i I lustrated in Appendix D. The desired results uere achieved by combining 
the above, modification' uith another modification; the criteria for 
deducing that t^e player had mastered a given skill uas louered somewhat. 
Previously* the situation had <o have been such that the selected move 
uas better than some other move uith respect to a sln(}le danger and 
identical (no di f ferenc^e) -ui th respect to the other tuo dangers. Thgn 
Ulueor uguld note that the player had given the appearance of mastery of 
those rules uhich uere required to justify the superiority of the better 
cave for .the relevant danger. This uas relaxed so that, if there uere a 
^ingje deciding danger uhich made the eejected move superior, the tuo 
moves had to be one of the follouing uith respect to each of the tMO 
remaining dangers; 1) idenlJcaU '^^2) such th&t the player should have 
perceived that they involved the same ri^k, or 3) such- tnl% the player 
shoul'd have perceived that the b^t^r move ^^jcThyed a ^eat^er risk. 
Thbse tuo modi ficet ions, along uith fixing various outright bog^r-.^^! owed 
Uusor to advance the student to colnplete mastery of the game in roughly^ 
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thirty gaAM (a figurt which it contidartd acceptably for a tutor 
datigned to work with children), 

Tha MKt teriaa of aKpariaenti ware tuch* th^t Syndi used a fixed 
aiAaet 6f the eKpert*e knowle<|ge^. and^ Uyaor etarted with an initial 
eetiMtion- of no knowledge^ ^of the; game* In these ^Kper inehts, Uusor 
advanced rapidly to theTattual state (ar it did before), but- rather than 
etopping, it continued to advance the student* slowly, albeit sUreJy. 
tKis required the addition' of the ifQrf * coeptete anet^^sts foe 
probabilities described in Appendix B^. Of cpurse the ortgina) 
experiments had to be run over again, out it was found that in aM cases 
Uueof would advance to ' the correct knowledge state arni then make^ no 
further preeuaptions of the student^a knowledge* The advances , proce^dea 
at ap acceptable rate. The only non*optiaal performance by Uusor. was due 
to problems in implementing Syndi. In developU^g Syndi it was found that 
it was necessary that she .have some minimal knowledge of, the ganre at all 
timet in order to model evea beginning players* Jhe required knbu-iedge 
wae am understanding of wha.t it meant to have encountered a danger, uhat 
it meant tq have tafely visited a c|ive, ^% a rudinfentary understanding^ 
of whatsit meant to shoot into a cave/ Thi problem was that the 
r-ud imentary understanding of ' the shooting principle ^ (P15) wouid 
occas'ional ly cause Uusor to advanqe the studeh't slightly beyond the 
actual knowledge state, assuming a fill t- mastery of rule PIS dnd the rules 
aeeociated with it when, in fdpt, there was bnly a partial mastery (i.e. 
Aeeumption 3 wae violated). 

The n#xt eet of experiments were of the Type 2 described earlier, 
Syndi was starteql with a fixed, but limited knowledgs c)f the game, uhile 
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Uusor initial ig assumed that she had complete naeterg of the game. The. 
ideal uas that Uusor uotj4d degrade his estimation of Syndics Knowledge 
until it corresponded to the ac^al knowledge and then make no further 
change. Several exper i tnents were fiin with different knowledge states for 
Syndi, Hany of the satue problem's that were encountered in advaaeing the 
student we-^e enco^tered in degrading the knowledge eL^^mati/on, It was 
found that there were not sufficient game situations which would clearly 
reflect ©n the application of rules Pll for bats/pits (as in* advancing 

• i 

tne studeiit ^or the same ru^esl. The pi^oblem was that the id^al 

situjations which had been introduced to aid in tMli advancement of the 

student were always one level more advanced than ^lould be necessary to 

degrade the- student* s knowledge model. Fortunately fhe implementation of 

the ideal situations had been such. that Uutor was only able to create an 

ideal ^situation appronjroately one fourth of the time ^' i and this 

allowed Uusor to ti%^^^to create^an t^eaj situation foi^ a student of the* 

next lower , level (and, the^next Rrore advanced level) if it failed ^o 
»• 

» »* 
create the ideal situation for the giveji l^«l. This uas sufficient to 

t ' . ' : » ^ 

overcome this problem. 

Another 'problem that was *Wncouotshad when running the Type 2 
experiments uas that Syndi somefimel would not ^r i sk' pi t^ often enough^ 
alloH Uusor to analyze her knowledge of the pit rules. This problem had 
been encbuntered earlier whM^test ing Uusor^s^ ability to advance the 
student and had been soivid by assuming that knowledge in one\ oTf the 



bat/pit domains would be transferred to the other domain, ^solut^on to 
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^ ' ^^ Thie was done to restrict, the Itessibi I i ty ,e>f the. student deducing 
that Uusor was modifying the game. 
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thm problem would have been to conpletely tie the tuo domains together 
ut.th a reeultinj} lack of ^lexibi litu (elncr Uueor uould not be able to 
dtagnoee failurte to tranefer knowledge fr^ one donain to the other). 
It uae decided that the. decrease in flexibility uat not warranted in 
light of the fact that decreasing Uusor*s estiiation of the student's 
knouladge uae not ^ the noraal node in which Ugsor would function.^ This 
eaae trade off caae up when it was noted that Uusor would sometimes 
^Mjpugh rarely) noter thatf the player had dewonsthated a knowledge of 
r^ea which the etudent did not, in fact, posseee. This was caused by 
the reduced requir^nents for demonstrating knowledge of a rule which uere 
Jnplemented' whi le running tfte Type I experiments. In particular, because 
Uueor assumed that the student would recognize that ^a move was uiorse 
because cf a certain danger - (and in this case that was a ^false 
aeeutt^ion), and therefore conclude that he he myst have eeen the virtues 



of ^ the move with respect to another danger (since hr chose the move). 

to be 



Thie uae determined to be a minor problem because the problem ^as very 
unlikely in normal si tuat Ions , (since Uusor would not be that far off in 



hie eetination of the student^s knowledge) 'dnd because Uusor eventuaHy 
corrected for the err^r. ^ To return te the more • str ingent requirements 
would decrease Uusor *s ability to advance ^hi^ student (his normal mode) 
withou/t significantly affecting Muibr*s ability to decrease his 
eetimation of the student '-s knowledge. 

The'above two ^ets of expeTimente showed that Uusor was completely 
accurate in ite ability to increaee its estimat ibn^of the student's^ 
knowledge to the appropriate levml (and not beyond) whtn it? intrinsic 
aesumptions u«rre valid. It was. also found vth^t, when the assumptions 
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uere violated (in* particular, the as^nption that the student uouid not 

« 

have partial or incoi»p<^te understanding^ of a rule), Uueor could dialjnose 
the gereral level of the student, tno'^gh^its estliiiation of the student's 
Knowledge of particular rules uas n:^ aluays reliable. It uas also fourrd 
tha^ Uusor^ had a limited ability to decrease his estimation of thq 

^ student's knowledge, though this mod^ .uas not nearly as reliable. In 
light of these results, Uusor*s initializations of the student's 
knowledge were 'alwaf^s Kept on the conservative side. '''' Having^ 
verified that Uusor'e analysis of the student's actions were working, it 
was then appropriate to insure that Uusor could, give advice on Sll the 
different aspects of Uumpus play. Tf^is was to 'insure that, if the 
student could understand U'jsor's Explanations, it would be possiffTe for 
him to beco'ne an expert in Uumpus play without any outside help (i.e. 
there were not any holes in Uusor' s curriculum). 

The fimal set of experiments Mere of Type 3, in wKich Synd i , star ted 
with a minimal knowledge of the game, but uou'd learn each rtile as soon 
as it Mas explained to her. After a certain levej, Sgndi would begin 
transferring knowledge between the bat and pit domains. Uusor started 
with a correct estimation of Syndics ability* Of course, Syndi * s ab ) 1 i ty 
to learn is rather artificial. Uhen Uusor notes that he' has j'ust 
explained a rule to the student, Syndi wi i I be so, informed '^Ss'J^el I 
(thereby allouing her to begin .applying the rule in question). Another 

♦technical problem uas to decide hou Syndi shouid aodify hfer behavior uhen 



^'''^ The claim that Uusor's ini t iai izat ione of the Sfudent Model' tends 
to be coneervative <• justified by the facft that, in reak usage. Uusor 
typically starts the student at a certain level and quickly advances the 
stu(Jent.-to a. more appropriate level; after uhich advances tend to come 
wore slowly. ^ f 
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•h« f irtf itarntd 8 rule. Should she recalculate her entire data base or 
change it ae her attention Mae called to it. Thie.uae very important as 
human *p I ay ere do not take either extreme (but* inatead, do a little bit 
of both). The ganeral tack that wae taken uae to emulate a human player 
ae much ae poee i b I e. For examp I e , if a pi ayar did no t pr ev i ous I y 
undaratand the ei gni.f icance of uarninge/nowiarninge, it le unlikely that 
ha would have kept a record of this information. Uhen he di^learn their 
meaning, he would haye to revieit a cave before he would able to use the 
information of ! te warninge. So it uae with the data base with Syndi. 
Thie ke not true of the more complicated rules ae they eimply involve 
better ueage of the available information. Thie aepect of human players 
uae also modetfed in Syndi* 

In the Type 3 experiments' it was found that Uusor was able to fmd 
situations to advise the student for all levels of knowledge of the 
bat/pit domat." (again, thie wae largely due to Uueor*e ability to modiry 
the game to create ideal situations for bat/pit knowledge), but Uusor uas 
r\o\ able to ever advise the student with respect to .the rules of Phase 2 
of the Uumpue. This was because of a bug which made Uusor unnecessarily 
restrictive in the situations where it would adviee the player about 
these rules. ^'^^ This bug 'was fixsd, and Uusor then began explaining to 
Syndi the rulee of Phase 2 for the Uur.pu8. Once this obstacle mss 
overcome, it wae found that the situations in which Uusor would explain" 
the rulea of Phase 3 for the Uumpue were extremely rare. This problem ? 
uas fixed by creatkig a new Combination Rule, Combination Rule Seven. The 
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^^^^ The bug wae mutuallu^axclusive requiremente prior to the explanation 
of Combination Rule 5. _ ^ 
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dk>ove tuo modifications .alloued Uoeor to advance Syndi from fne most 
basic feveh^ to the most advanced levels by first explaining a rule and 
then observing when Syndi applied the rule. In Appendix G there is the 
first part of theV'^otocol taken in a Type 3 experiment. It is indicative 
of uhat all the protocols look like. 

The Idst three of the five assumptions are most questionable. The 
above experiments inoicate that Uueor functions as desired even when the 
third assumption (the assumption about incomplete' understand tng of rules) 
is violated. The fourth a§sumjDtion tha't the 'player does not make 
mistakes is obviously invalid, but, because of this, Uusor uias designed 
TO be cautious in i ts ''conclusions (thereby decreasing the detrimental 
effects of mistakes). , The remaining questionable assumption is the^ 
assumption- that the player understands Uusor' s explanations. There is 
eviderce that Uusor 's, in fact, Effective at tutoring students m his 
ga^e strategies. Uhile* the 3bov% experiments were being carried out> 
Uusor was accessible 'to the general community at the Artificial 
Intelligence Lab so that anyone who was interested could play with Uusor. 
Roughly 15 students played with Uusor extensively with reasonable 
results but there was one disturbing anomaly. It was known that 

there were more situations which allowed the student to demonstrate 
knowledge of the Uumpus domain because Uuior advanced his* estimation of 
Syndi in this doiRain-much more quickly than in the 'bat/pit domain. 
However, when Uusor was being used by actual students it was observed 
that knowledge of the bat/pit domain far exceeded the Ulumpus domain 



^'^^ This is the subjective evaluation of the author based on his study of 
the* complete protocols kept by Uusor. 
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b«yond PhaM 1. It uat feared that this indicatad that Uutor aseuRiptions 

Mmrm not valid, but than it*uat ditcarnad that Uutor was unable to tutor 

atudantt on tha aore advanced Uu»put rulatt This, in itaeM, iS 

indicativa that' students do tend to adopt th^se strategists- expiained iDy 

Uusor, though stronger evidence uill be gaivneo if students advance more 

Qu>cKlg ]n' the Uuapus doaain nou that Uusor can advise them in these 

^aKills.<^^^ • ^ 

Uhan a large tutorial prograa, such as Uusor, is dee^gneo uith such 

varied behavior, it is extremely difficult to determine uhether or not 

tha prograa functions as desired. However ,^ thi s testing can be vastly 

sinplified through the use' of a Synthetic Student, Syndi served to test 

Uueor in closed ex^erisents uhere all variables couid be controlled 

(Syndi never ha«t a bad day)/' Of course, experiments with Synthetic 

Students do not conclusively show the effectiveness of a tutor, but they 
\ ' * 

do serve .as a wonderful debugging aid. Uith a Synthetic Student, «t is 

y ' ^ 

possible to determine whether or not the program functiooe as desired*: 
tha determination if. the correct approach was t^en hfs to be determined 
through otheif' exper iments which are of a more global nature. Ue will go 
on to de'tcriM these global experiments in more de^tail. 
Global Resting 

' , ' The Global Testing is the next step in testing the Uu^pus Adviser. 
One^of the^goali of this phase of experimentation is to test out the 



rai at i ve mer its of di f ferent tutor irg strategies, such as graph t ca i 
versus verbal . However, the' main goal of these exper i ments is to 



^^'^ Tha* reader can also verify that Uusor's explanations are 
conpaahensfbia ,by studying the scenarios In Ap'^endix E'and Appenoix G. 
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determine how yeti the . UUmpus Advisor actually teaches better game 
playing (if it does, In fact, help studente waster ,the garoa). The 
exper iaerj} would probably be a rather sinpie arrangeaient involving a 
total of roughly ten students. Five of these students 4J0uld be^aiiowed 
to play the game of Uumpus (as modified in this paper), without the 
Advisor, The remaining five would be allowed to play the game 44itn the 
advic^ of the Uumpus Advisor. At the end of the testing period (uhich 
uould almost certainly extend over a perjod of about two weeks to a 
month), the students would i>« tested on their understating of the game. ' 
There wojid be the objective results of the percent^e of games won and 
tost when the students were allowed to play, ui thout any help, but there 
Should also be subjective results. The ttudents shouM be tested on 
their ability to make deductions, their ability to eetiaate dangers, and 
their general understanding of the ga»e. It is expected that the 
students who played w-th the Advisor wiJ I not only play better (as 
indicated by their percentages of wins and losses) but also have, a better 
understanding of the game. 

The final experiment is to test the Uumpus Advisor's ability tp 
teach setter ways to think about problems. Only a general outline of the 
eK)Deriment will be given as the details will be dependent on the results 
'of the previous tests. The experiment should involve about 150 students 
to allow for statistical evaluation, i At the start, all 150 students will 
be given a te$t that measures their ability to think about problems 
(probably an I.Q, test with emphasis on thinking ability). After the 
test, the students will be separated into homogeneous groups of 58. The 
first group of 50 Students will be left alone for six months. The second 
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group will play th« g«»t of Uu«put without th« Uuii^ut Advisor* The ias^t 
group Mill play tho ga«t uith tht Uu^put Advisor. Tht sKpariment uili 
Qontinua for. n\x Months uith tha active atudanta playing Uumpus for a 
apacifiad por iod each ueek. Finally, a'l I tha atudanta uili be given a 
variation of tho'briginal teet» In thia aanner, It ahould be possible to 
teat both tha gaaa of Uuapue and the Advisor in their ability to teach 
better thinking habits. 

The large size of the groups^ to be teeted is essential as it Is 
doubtful that any ore force can be that significant in improving thii^ii4rig 
habita. Uith a ^nailer sanpling size it is possible that the smaH 
increwente in thinking ^bili ty uoold be lost in the norn^l noise that 
accoiipanies such testL It is also possibis that the results uould not 
be conclusive even uith such a large saepling, but there is no uay to 
predict this. A significant nu»ber of the subjects 'n the standard 
curri cuius of the public (schools are jU8ti>fied by the hope that mastery 
of the given field uili help the student develop be'tter uays to think 
about problems. Houever, no one seees to have made a significant effort 
to verify these claie^s of improved thinking habits, and so it is very 
difficult to estimate the sample size uhich uili be necessary to arrive 
at conclusive results. The proposed test should help to clarify hou large 
a eanple is required to arrive at concljusive results in such a test. 
Conclusion 

The UOmpus Advisor has been thoroughly tested to deoug it and fine 
tune its tutorial ability. Concurrently, consideration uas given to the 
varioue programming decisions, uhich usre made according to the judgement 
of! the programmer dus to the lack of concrete ^evidence. The Advisor has 
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be«n determined to be '^readg,/ testing it in progrese to determine the 
Advisor's ability to teach better game playing. This exper^Rient Mill be 
on a relatively ^rnall scale because it 'is ewpected that the results wtil 
be concluei v|i in any case. However, Mh6n the UuRipuo Advisor is tested' on 
its ability to^ctually teach better ways to think about problef(fs. the 
results are not expected to be as obvious.. For this reason, a larger 
sampie size is necessary if the experiment hopes to be *conciusive. 
Finally, based on the results bf theee experiments, further work leading 
to' Uusor III could be warranted. 
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The Cone I urn i on «^ --^ 

Chmptmr 9 - 

A n#u gentration of Computer Aided Instruction (CAI) is evoLving 
which transcends past litsitations by using Artificial Mntei i igencB (AI) 
tecKniquas*. Thsfa nau^ programs are AICAI prograas since they incorporate 
the concepts of Artificial Inteiligsncs uhi Is Maintaining the goals and 
objectivee oi Coaiputer Aided Instruction. AICAI is a field uhich 
contains Mny interesting and challenging probjees, the I4umpu8 Advisor 
being just one eKaapte. 

The« UuKpus Advisor applies aany of the techniques developed in 
Ar t i f <ciari Intel I igence. , It ^^r\\%r% around a rule-baeed Expert ^hich 
uees heuristios to arrive at results that are both reliable and 
understandable to humans. The rules of the Expert are organized into a 
cur^iculual uhich is taught by the Uuapus Advisor as -apprdpr iate. The 
rulee of . the Expert are also the ^loundat ions for the Student Knowledge 
node!. The Student Learning tlodej interprets the Student Knowledge Model 
and dteterminee uhich rules the st%Jdent is tsreeuaed to have learned and 
klhich ruleji are acceptable for teaching, tn naking these determinations, 
the Student Learning flode I makes ex te-^sive use of the Student Lfearn i ng 
Vector. The Expert* s rules are also ^the basic francuork around which the 
English generation routines are built. The fact that both the- Student 

Model and the English Generator are designed around the rules of the 

* «» « . 

Expert al l-ou the English routines to prune their 'Engll sh according to the 

«» 

student*e knouledge. The logical grouping of the Expert's rules in the 
currtculun alfeo alloup th6 Engl ish .rout in»t to be conteKt 'sensitive 
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w"*! thout 'lengthy computations. Ttie essence of the ii»proved Uumpus Ad.visor 

I 

is the different rules .of the Expert and their interrel^ionships. 

The main limitations of the original Uumpus Advisor uiere due to the 
lack of a clear understanding of the k^uiljidge to be taught. Once this 
knowledge had been broken dov-n rKtp^speci f ic items, the development of 
the remainder, of the Uumpus Advisor uias relatively straight forward. In 
more interesting problem domains {such as chess), it will probably not be 
as difficult to develop the rules for the expert, because the problem 
domain will have^been analyzec before the program is begun. The, nrain task 
wilt be to break down the knowledge of the problem doTnain into rules. 
Th's wirL ariow more effort- tc» be directed into those areas which are of 
more theoretical interest (sucn as the Student flodel). 

4 

. The next logical step bayond the Uu»pu| Advisor will be a program 
that teachee'sk; I Is in a proiilem domaio-that can not- be ^na<yzed with 
absolute certainty. An importa/it asset of the, game of Uumpus was tfiat it 
^as possible to discern a single b^t move and explain Mhy. In problem 
domains suQh ae chess, it ys not possible to^know absolutely the <i^lity 
of woet moves. This would handicap an advisor since there would atways,bq 
the possibility that the expert would not give correct advice. However, 
this is a handicap scared with human teachers. An advantage of 'more 
complex problem domains is that the Advisor will be able ^to teach 
principles and concepts whi ch can not be represented within the limited 

r 

domain of.Humpus, For exampie* the formal methods of decision theory 
^uld not be taught e.ffectively within the Uumpus domain, but it could be 
taught In more complicated domains. .An advisor which functioned in a 
more complicated domain could be built along the general lines of the 
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V ^nuiipu« Advifop. but itt Student Model uould pjpqulre significantly more 
* / ' \ 

, •ifort« -An advifop fop a mope cogfiiirated domain uould neid* to be more. 
^ flexibl^^in Itt enp I anati'one to the. student -einceNhe^ adyeop would not 
.be at ceptafn of the pttu^ of itt tKpept, The^ppimapy tource of this, 
incpedted flexibility uould be the Student flode.!. ' . ^ 
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Mpdulmn Dimgrmm of the Vumpum Advtmpn 

Apj^rnnd^M A : 

Each tub-iiockjlo of th« Quttput Advisor, has a uhique^^efix uhich 

.idantifift all tha routinae of that •ub*aodula< Thataj^raf ixai are u^ed 

. \ 

to idantify tha €ub-aodul#6 in^ tha flou chart. Each subHiodule performs 

a particular task uihich is dasferibed 4n the rsaainder of this Apipi^ndix^ ' 

. . . - ^ ' * " p 

' y ' . . ■ - . > 

Tke^ Vumpus Executive ^ . ^ 

VE" is the _pref ix for the Uuapus Ej*ecutive_routir»es.. 



'UG- is for the Uuapus gaae. 



^ . — — 
a 
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UA- is the prefix for the Uulnpus Advisar routines* 

UAU- is for the routines of t^ i^unpo'^ Adv i scr which keq^ track cf 
^ tha route taken »?y the player C^-^s.^^^ ' 

MAO- js for the rout irif8H**iH^h coapUte the distance to diffe'^ent'/ 
' -caves froa. a givc|g starting point. They ^Iso coapute routes, etc. .* 

UAH- ie for the Uoepue Advieor routiner whJch Modify the gam^^ and 
, create the varibus starting situations* 

• r^e ExperV" ' ^ ' ^ 

I > - ^ 

XX-^s for tha ^>^aculiv*e for the Ui^us Ei<pert.« It activates tne other 
^/ sub-'Wodu lee and then coabinee their reeulte. ' 

XD- Is the prefix for 'tHe'Voutines Mhich- aalhtai n the ^tata base 'for 
A \h9 Expert, They a I eo compose* the "rKJBE-THAN-'and •'EXACTLY" values. 

YSf ro6tines keep track of the different ^cave-eets,^ notidig yhich 
ire cofqLLfte, atc«« J * ii' ^ ' • 

' XR- routines identify those cayee utUch ayst be safa baaed on 

global consideration of the cave«-eete Jor a particular danger and the 
% nuabar oi the dangdhe in "the warren. \^ . 
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XP- ie the prefix for the routines uhich compute the probabi I i t res 
f^r th«r f ferent dangers. — ^ 

. ' . ^ 

The Move Comparer 

CX- is the prefix for the Result Explainer routines. Thly return 
the rules uhich are necessary to justify the result^e of the Expert,* 

^ CM- is, for the "^ExtJIanation Cowpar^er, which compares the rule:4 
returned bg the«Reeult Explfjner and deteriiines ttou fareii^iar the student 
i^U'ith the rules in question. 



The Psychologist 
PS-.is the prefix of the Psychologist. 



. The Student Hodel ^ , . . 

SK- is-the prefix of^ the Student Kncjuledge Model. These routines keep 
track 'of the student's knowledge ff the different rules. 

^L- is the prefix -of the Student Learning Model. These routines estimate 
^ow ^gickly tbe student iearns viateriaU forgets same, etc.. 

\SC- ie the Student Hpdel Crituc. It adjusts th^ Sj^udent , Learn i ng llodei 
as ajJpropr iate. . ^ 

SF- routines maintain- tha^isc files on ihe different users. 

The English Generation Module ^ 

EX- i3 the prefix for the routines which generate Engl i sh to explain the ^ 
results of the Expert. ' 

EG- foutrnes generate cieuse's in English that convey a particular 
^^oa^pt (such as "N. caves away from**). 

\ , . ' • ' ' 

V r. * ■> 

» 

Utility Routines . ' 

^ 9 

JGP^ is the prefix fd^generat purpose utility fundtions whTicb expand the 
ab*i I i t ies of LISP. , - ' / . 

r * . * ' 

G- routines are ^the I/CJ' routicee of the Uumpus Advisor. . 
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GQ^ routines quer^ th« student Mtth.Btanciard quest io^is and return 
lfi\B responsp once it is in an acceptabfe fors. % 

GH- ere genera I purpose rout ! nee uhi ch do aapp i ng ( such as a 
routine to do flAPC non*deetKucti.veiij)» 

' GC* routines do the proceeeing of the circuter list which are used 
in English generation and FIFO etacKe, 



fLAftH ie an extraneous variable, in an otheruiee conceptually clear 
freaework. Thie anachroniea Mill be elieinated ae eoon ae pcesi^ie. 



if 

s 
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Appendix B ^ • ' " 

Th« Hovt CoMp^r^r it rttponsibie for taking two moves and^ 
Juett fifing th#ir relativa aarita uith raapact to a aingfa danger ulthN 
ap#ciflc rula nuiibart* For th\n purpota^thara are tuo aaparate sub- 
iioduia^ to parfori^his task. Thata tuo tub-aodgiet ara the Resuit.f 



.Explainer and the Explanation .Coaparar,- first, the Reault Explaioer 
datera-inaa uhlch rules were iSsed by the Expert to arrive at a specific 
reeutt,^'^ Tteen 1fr»e Explanation Coaparer takes {wo results and comparers 



the different rules involved. In this fash^ofii, the flova Coaparer^can 
return the rules whufh justify the di f f erence betwaen two pos^sible moves 
with respect to a *<Mle danger. The flove Coaparer- al so p^rforing various 
other functions; priearily, fhe Explanation Coapartfr consc^its the Sfudan':^ 
^Learning Hodal and deteraines if the student knows the rules in quest ioOt 
are they acceptable for teeching, etc.. This is a^ cursory overvi^ of 
the process, but we have oyerlooked aany of the probl^ns of such 
coapar i sons* In fhe remainder of this Appendix we ut4^* look at these 
iasues aoretclosely. , * . ^' 

4 

U)ien the Uuapus AdvKSor coaparing two difierUnt AK^ves \\ must% 
occaaionally consider which of the probat^ity rules is involved. T:hls 
ie true if the Uuapus Advisor y|^^^n|lyzir\g the itudeht*s aoVa to update 
his Student nodeU'or if the Uuapus Advisor^ is deteraining .^i f ,lt can 
explain a particul^c^ good aove to the player. In any cde^« the Hove 



\ 



In .this ^1 ight. the Result Explainer Is structured a^aoat axact ly 'I ikS' 
the Expert. ^ . r • ' ' n 
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Coiiparer iROst be ^bie to decide k^iich probability rulee are applicable 



\ n 



different situation©, , H . * 



i 



The UOttpue Expert only considers the Mst accurate probabi i i ty 
rules, in its analysis, but the Uuapus Ativisor mu\t be abU to determine 
*^h(sn 'less advanced probability rules aVe involved* in a particular 
comparison. *For^afliiple, in Figurfe B.V there is a common situation tbat = 
is presented to moderately advanced players* Cave 8 i's v6ry likely to 
contain a pit because of the double evidewc^ of a* pit (i.e# the breezes 
which were felt in caves 3 and 12). This makes it rather unlikely that 
either jjf caveij>_and _18 contain a pit -since a prt in cave 8 uould 
explain the breezes in caves 3 and 12. The^rule whicn justifies the high 
^probability of a pit in cave 8 is P13. The r^le which justtfies t^e low 
probability for caves 4 and 18 -is rule*Pl4, Now, if the UuwpuB Adv-i sor 
were comparinjj the two probabi I i ties ^for caves 4 and 8, it might note 
* thai rules P13 and P14 were both involved in the comparison. However, a 
4tude>nt , could i<.now oniy rute P13 and not rule P14, and he woulo stiM 
chooee the better move. CorresDondingly, the Uumpus Advisor could 
tK/ala\r\ wrty cave 8 was^ a bad move -by simply^ explaining how P13 applied. 
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Such tltuatione requijra that the Uuapua Advjsor (In particular, the 

llova Coaparar) aaka a datailad analyaili Mhan tuo probabilities are being 

6o«parad. For thie purpose, the Uuapue Expert coaputae the probability 

for avary cave^uith respect to each probability rule. It then chooses 

tha prefared probajDilitg (the aost reliable) and saves all of the 

different probat)i ^i tiae. The first etep of the Uuapus Advisbr's analysis 

ia to inauree that one cave actually dcee have a louer risk than the 

other Bove.^'^^ 1 1 ^l^n deteraines which of the follouing cases applies 

by chacking thea in-order* 

A) If the bett*ar cave (fitfttar) is safe, then tf^ only applicable 
rules are the rules uhich aake B4tt$r M^iam4^J^hii\n because 
tha Dresuaptiorf is that cavee are moderate I u daroeri^^unless 



tha presuaptiorf is that cavee are moderately darger^^jnless 
thars is sofl^e evidence indicating that they ar,e safe* 

B) Correspondingly, . i f Wofisf is captain to contain the danger, 
.than the only applTcable rules ars tha rules uhich shou that 
Worse contains^ the danger (no^al l|S L8)* This is because the 
prasuaption is that Better is Moderately unsafe* ^ 

C) If' both of the above tuo ruj<es ^re applicable, then choose the 
sinpler of the ^two explanations (least advanced) as the' 
necessary explanation. 

04 If tha coJBparison of the tuo PU pf^obabi I i tie^ Mi I I justify the 
quality of tha Better l^9ve, then PU is the only applicable 
rule; . ^ . . ■ 

E) If P12 is applicable for the Better cave*s probability, th^n 
P12 is th^ only rule that is appiicable. 

F) If the P13 probability for Woras is greater than the PU 
probability for Setter, then PU and ^13 are the appropriate 
probability rules* ' * 

G) If the P14 probability fdr Better is* less than /the PU 
j3robabHity for Worse, then the probab i I i ^ rules uhich are 
applicable are ruleaPll and P14* ^ - 

H) If none of the above apply* t hart use the s/apt^st probabiKty 



f *" This coapariaon i a based on the "preferred" probebi I i 1 1 es of the 
ikmpue ^xpert*^ • ' • 
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' rules which uM I justify the ''preferred" probabi I i tyr ' * * * ' 
In this fashion, the UuBipus Advjsor determines the eimplest possible 



rules which can justify the difference between two caves. A This 

^ 

informatifon is used in analyzing the student's move as well as in 

determinmg whether or not the better move is suitable for eKpiammg for 

the studen't. Once .the Uumpus Advisor has discerned that a move^can be 

* 

explained W the student, it then determines the best rat i ona I e ^Joj*^ 
explain to the student. In the example above, the Uumpus Advisor might 
decide ta explain to the s'tudent that cave 4 is a better move. Depending 
on Uusor's estimation of the student's knowledge, Uusor* would choose to , 
'explain either rule P13 or rule P14. UvAor's explanation would center on^ 
rule P14 if the student already knew rule P13, %nd the explanation woulc||^ 
center on rule P14 it the player was no,t yet advanced enough to alloi^ tine 
expTanation of rule P14. 

Once Uusor* has decixied to explain^ the comparison between two moves 
and has selected rationales to b3 ' explained, i \ must then^ create an 
explanation with the appropriate emphasi-s. The points of/ emphasis of 
such eKplanations are shown in Table B.2. * ' 

Table B. 2 



Rat ionals For 
Bstter Cave, 


Rat ionais For 

Uorss Cave 


Emphasis of Explanation 

^ \ u 


Rtffe Pll 

Puis P12 

Rule^*14 > 
No't Rule P13^ 

Rule PiS * 
. Any Other 


Rule Pll 
Nc^t Rule P12 
Not Rule P14 

Rule P13' 
Not Rule PIS 

Any Othsr 


The Cave-Setjs involved 
The sxplanation of P12 
The explanation of P14 
The explanation of P13 
The sxpfanation of PlS 
Both ProbM! 1 itiss 



*lt^ a cave is only a member of one cave-set, tVien the 

probabi 1 1 tiee ^or Pll, P13, and P14 wil'l be equal' in most cases. 

Therefore^ Pll is applicable for that particular cave. 
• ' 1* 
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Uuftor uill g«n«rat« the explanat ion which first fhe. ExaiBplee of some 
of Xhmee •xplanationt ara in AppandiK 0* 



• 
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AnQ I ys I m of Game Mod i f i cat i ons 
^ Appendix C - 

Before the start Of a game, tho Uuiput Advisor uill attempt to 
^modifu the game to create a si tuation' ^hith ie thought to be a 
challenging problem to the student.^ This is done ^ by looking for a 
starting ^ave within the warren which meets all the requirements of the 
Sitwation desired. Typically, the requirements will' involve the warn^ings 
.at the cave in question's well as the warnings in one of. its neighbor log 
caves* If a cave is found that meets all oi the requirements, the Uumpus 
^ Advisor uill move the starting cave to the desired cave. Then, ;U)e 
player will be informed about his starting location (the. one selected by 
toe Uumpus Advisor) ^nd what the neighboring csvef are that#he can mpve 
to« Once the flayer has sslected k cave (at random since he does^ not 
have enough information to choose wisely), Uusor uill transpose the caves 
of the warren so that he moves toj the neighboring cave selected by the 



Uumpus Advisor. The requirements for^ starting situations vary ^or 
"litudents of differenjt p^ses. These requirements are shown in Table C.l. 

/ ' ■ - 

' Table C.l, 



Phase 


Smarting Give 
Requi^msflts 


Ne i*ghbor*s 
Uarnihg • 


Requirement On 

Overal 1 Situation 


Teaching 
Point 


a 


No Uarnings 


^Some Uarning 


None ' 


' Backtracking 


. 1 


Bat or Pit Uarning 


Other Uarning 


Neighbor in Common 


L3 and L5 . 


2 


9at or Pit loping 


Samef Uarning' 


Smal ler Cave-Set 


Pll 


3 


Bat or Pi t Earning 


S^me Uarning 
. 




Neighbor in Common 


P13 


4 

i . 


No Uumpus^Uarning 


Any Uarning 


None 


P13 (Uumpus) 
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En9mp\mn Of •ach of tha.M aituationt ara ahoijn in Appet^dix 0. There are 
not acceptable atarting cavea^ in eany uarrana^ ao that the^umpue Advisor 

only createa theae" ai tuat iona roughly half of the tlap. This* uhen afdded 

- - . ^ . ' • • • / ' - . ' - 

to the fact ^^re are varioue poaaible atarting jonf igurationa for each 
phaee» should be aufflcient to prevent the atudfdt froi ever recognizing 
the aiKilarltiea of the atarting aituationa before he ia in a neu phase. 
^'^^ Houever, even, uhen the tiuapua Advtaor doaa not egdifg the gameu to 
create an idea^T aiiuat'ion^ it^^jU transpose th^ player* a, ^fr'st move, if 
It is ,to a cave containing a danger', thereby preventing the player from 
everyosing on tha first move (uhich (Jio-have vi<ry bad affection ^mbra^le) . 
Thie apiHty to transpose aovaa can aaaily be extended to give positive 
. or ^egati v« reinforcemsnt as n^ces^ary. 



' / 



Thi« it a hypo^hesit uh^eh .h«9^ not gat baan vai* 



aKpar) Mentation. 



through 



Th9 yumpus Advisor 




ExBimpJmm of /deai Sltumtiontt and Prob&b i I i ty CampQ 

Appmnd I X D 

Thif appendix coptains ^amples of *the "ideal siVuations" that uere 
created for students, in di fferent phases along with the corresponding 
explanations. The requireroentfl for the situations are given in AppencJix 
C an^ the struc^ture of the explanations is given in-Appendiv B. These 
are 'actual situations created by the Uunipus Advisor and the actuai 
explanations given. ^ ' 

A begmnlng player (Phase 0) uho i'6 being taught^ the rules uoUld be 
faced uith a situation very similar to this. 



Figure 0.1 



13 



Squeak 



-18 



This eituation uould give rist to the folloMing explanation if the flayer 
asked to mo^ to cave 18. 

_> 

Brian, did you knou that ue can backtrack to caves that ue 

have already, vis i ted? Yes ' * - 

Uel I then uhy not go back to cave 3 uhere ue 
didn*t get any warnings at all. 'From there ue can safely go 
to cave 13 uithout risking the bats«- Jt ie not ulse to visit 
caves uHh bats because uhlle THEY ui 1 1 not harm us they uill- , 
cArry ue to another cave uhlch could centain a pit or the ^ 
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^ Uould uou liki to go to cave 18 anyuau? 

A -pi agar who was slightlu aora atfvancad (Phasa 1) and presumed to 
'hava'gottan a baalc undarftanding of tha Fulaa, uould ba faced with the 
fol lowing altuationr 




Squeak 



f thi 



player 



Thie aituation uould give riea to tha following aKplanati'on i 
aakad to aova to cave 8. ^ 

Brian, ue don't need to risk bats in cave 8 as cave. 
^ IB i e ^eafe. Cave IG can rot contain bats because, if bate 
werW there, ue uould have heard squaring in cava !!• It 
is beet to avoid d^ts as they could carry ue to a fatal - 
cave. 

Uould you like to go .cave 8 anyuay? 

A ^p layer who is pr^umed to'have aastered the* rules necessary to 
^ALacar rn ' wh i ch -^cavti^ajlg s_af> (Phase 2), would be faced with a situat^ion 
aliil lar to this. ' * • . ' 



■X 



ERIC 
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This eituation Moutd give rise to the- fol foxing exp'lanation if the play^ 
aeked to move to cave 18. 

♦ ' 

Bri^n, it isn't necessary to take sgch Large risks 
with b^ts. It is true that one of caves 8, 12, and.lG 
contains bats because ue heard squeaking in cave 1, but iTne 
of caves 18 and 11 contains bats because ue heard equ^aking 
in cave 10. This makes it less tikeig that cave 8 contains 
ba^s. Therefore, Brian, ue. night uant to ex(ilore cave 8 
instead. 

Ulould gou. tike tb go cave 18 *anyuag? 
^ A pLayer uho bit Metered the lintple probabllitg ruUt would be 
gi veru^ej tuati or. like this. 



ERIC 




p4 9^ 



( 



Thi« •Ituatlon uould give rise to the fol lowing •i^planatlon if the platjer 

aekad to Moves to cave 3* ^ 

Brian, it*'ien*t neceeeary to take euch large rieke 
Mith pite. One of cavee 3, 7, and 8 contaihe a pit. 
Lfkewieet one of cavee 3, 2^ and 6 co7>tain8 a pit. This 
ie Multiple ev.idence^of ^,|::i|it in cave 3 uhicb eakee it 
probable that cave 3 contaihe a pit. It ie leee likely 
tnat cave 8 contains a pit. Hence, Brian, ue Might uant^ 
to explore cave 8 Inetead. 

UtfuJd you I ike* to go to c|ve 3 anyuay? 

In the course of playing a game, a player of this level eould be 
faced with a situation like thie. . 



r 



Figure D.S 

[T] Visited Bat 



18- 




Th ie eituetion would give 
aeked ^0 move to cave 16. 



rise t<^ 



the fol lowing*eKplanation if the player 



ERLC 



Brian, it ien*t necessary to take euch large risks 
with bate. It is true tha^t one of* caves 18« 0, and 9^ 
contains bate« but cave 9 contains bats because we wore 
picked ups^g bate when ^e. visited it before. Thie explains 
all the evidence for bate in cavee 18, 8, and 9. As we t<> ^ * 
not have any evidence of cave 8 containing bats, we can . 
preeuMe that it is unlikely that cave 8 contaVne b^ts. 
' There ie evidence of bate in cave 16 which Makes it a more 
dangerous cave. Tlierefore, Brian, we Might want to explore 
cave 0 instead, 

' jhis ie an explanation qf rule Pl^ for *bats as described in 



^ Appendix B. 
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Smmple Wumpum Adv'lmor Scenmnio 

Appendix E ^ * ^ 

In the fohoMing scenar ioe, ^ both Uueor's statements and the player's 
responses will be indente^ to the actual fields u^edi the player's 
reeponee '4i 1 1 be underlined* These scenarios have been corfStructed by 
con/bining advice actually given by Uusor, but they are not realistic 
because Uuver mouIc^ never give advice so often and because there is not a 
consistent Student flodeT throughout. Thie Appendix is intended to 
give the redder sons idea ef Uusor*s ability to give advice m a uide 
.range of situations. In this rega(;d, it is not all inclusive since Ulusor 
has given advice in many, sUyations far renoved. fron the ones shoun.' 

Hello, wy name is Uusor VII. \ Uhat is your name? JIH STANSFIELD ' 

Do I have your name right, Jim S^ansTield? Yes 
' Uould you ! ike instructions? No 

Just a second uhile I erase fny blackboard. 

In this game, Jim, there Mi 1 1 jDe 28 caves aM total, three 
pits, and 'three caves Mith bats. .\ 

In yfact a nsM player uould not be pur in a Marrea uith eo many bats aj^d 
pits^ ^ i ' 

O.K., noM I Mill drau up a new Marren. % 

Ue are non at cave ^ 
The r^^ighboring caves are caves 3, 12, and 5. 

Uhat noM? 12 



Uusor'e behavior is .highly dependent on the Iturrent Student riocfrK 
and the folloMing fcenar ios have been designed with a euccessively more 
advanced Student Model, . In fact, the Student tlodel^ Mould not be 
advancing in such a ,«anner because of the consistent mietakee by the 
player. * • 

iPage.99 



10 1 



/ 



Th9 Vumpus A4yisor 



Appendices 

> 



iim are now at cave 12. ' ' 

The nei(Jhborlng caves are cavee-l, 18, and 6. 

Squeak* I hear bats they must be in one af the neighboring 

cavfte. > 



Uhat noM?' 1 



Figure E.l 




• 18 ^ 



* Jim, did gou knoM 



th^t Me can backtrack to cave^ that ue 



have already visited? No 

\ Uett MS can, so why not go back to cave B where we didnr*t 

get any warnings at all. Fpom there we' can eafely go to cave 3 

without risking bats. Ue should avoid bats bec^uss ttreg could 
drop us in a cave with a pit or the Uumpus. 



ould you like to go /cave i anyway? No 



*Ue are now at cave IZ^ 

The neighboring caves ^re caves 1, 18, and 
Squeak. T hear batSi 

Uhdt rK>i4? 6 ^ 

Ue are now at cave €. 

The neighboring caves are caves 3, 12, and 5* 

' ^ ^ . ' ^ i ' 

•iOhat hQHr? 3. ^ 



Ue are;'how at^cave 2. ^ 

The neighbor Vng' caves are caves 2, G, 5» and 47. 
Brrrr. I feel a breeze, we must be next to a pit. 
Uhewf whet s^etepch! That is* the suell of the Uumpus. 
Means that we are w^thiQ^two caves of the Uumpue. ^ 

Uhat\noU? Shoot' * ' ^ 



It 



ERIC 
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FigOrt E.2 




Into whVch tave would you like to thoot? 17 

Cave 17 can not contain tha Uunpus becausa, if the Uumpus * 
uere there u» uould have ameneti -him in cave 6 as cave S is 
within two caves of cave 17. IfXwe shoot an arrow into' cave 17, 
it coLjid ricochet back and kill us. 

Uouid/you iike'tt) sfioot into cave 17 anyway? Yes 

Poing 
Po i ng 
Poing 



Ue arq now aP'^ave 2, 

The neighboring caves are caves 2; 6^ S, -and 17. 

Brrrr. I feei-a breeze. 

Uhat a stench! The Uumpus is near. ^ 

Uhat now? 17 • . 



Hummm. 

Jim, we don* t need to risk a pjtfin cave 17 as cave 5 i;s 
•afe. Xave 5 can not contain a pit becauie,* if a ptt Mere ^here, 
we ^ould have felt a breeze In cave 6. Ue ehojlld try not td( 
stumble into a pit as \t would be fatal, 

, ' ' ' \ 

Uould you like to go to cave 17 anyway? No ' 

s • . V 

Ue are now at ca^e 3. *. . ^ \ 

ThQ..A#<ghboring- caves are caves 2, 6, 5, and 17. 
Brrrr. • ' ^ • ♦ " / 

UhBt 8 stenchl; . . \ 

Uhat now? 5 

Ue are now at cave 5. 

The neighboring caves are caves 15, 6, 9, and 3. ^ 
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Brrrr. 
Uhat nou? 9 




UeliS JiQ, I think that I uould rather riak bats in cave 18 
than pi ts in cave 3. 

Uould y^ou t'^ke to go cave 3 anyuay? No 

Ue are nou at cave 5, ^ 
The neighboring caves are caves 15, 6, 3, and 3* 

Ulhat now? Route 

Uhat cave uouid you like to go to? 18 

To get to cave 18, Jim, ue couid move to cavee 12, and 18. 

Upuid you. i ike a route to another cave? No 

are nou at cave 5. 
Th# neighboring caves are caves 15, 6, 3, and 3. 
Brrrr, 



at .nou? 6 



Ue are nowi at cave 6. 

The neighboring caves are caves 3, 12, and 5. 

Uhat ndlj? 12 * 

Ue are now at cave 12. 

The neighboring caves are caves 1, 8* 18, and 6. 
Squeak. 
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Uhdt nOM? 18 



This game uoiijd continue along the saine linae. Ue Mill shift, to a more 
advaViced player. 

Hello, iriy name is Uusor VII. Uhat is your name? Brian CAr 

Do I have your name right, Jri an Carr? Yes 

\l bel ieve that ue have hunted Uumpii together before, is that 
right? Y ♦ • 

Just a second yh^le I erase my blackboard. 

In this game, Brian, there will be 20 caves all total, three 
pits, anc^ three caves Mith bats. 




Ue a 



, noM I Mill drau up a neu uarren. 
are noM at cave 8. 
The r^eighboring caves ars qaves 6, 9, 13, and 10. 
Brrrr. 



Uhat noM? 6 



Ue are nou at cave 6. 

The neighboring caves are cavee 8, 5, and 0. 
Brrrr. r 

Uhat noM? 0 



0 



Figure E.4 



Start 



Breeze Brgeze 




HuMH. 



Brian, t< Isn't nscassary to take such large risks- uith 



pits. It Is trua that ons of cavap 13, S, and 10 contains a 
pit because ue fait a brssza In cava 8. j^ouavsr, one of cdves 

Paga 103 
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0 and 5 contains a pit because ue felt a breeze in cave 6« 
This makes it less likely that cave 9 contains a pit, and eo, 
Brian, ms might uant to explore cave 3 instead* 

Uou I d you I i ke to go cave 8 anyuay? No 

Ue are nou at cave 6« * ' . 

The ne i ghbor i ngj^ caves^are caves 8, S, and 8« ^ ^ 

Brrrr. ' 

" Uhat now? 8 * 

Ue are nou at cave 8.^ * 
^The neighboring caves are caves G, 9, 13. and 18. 
Brrrr. . 



Uhat now? I 

Ue are now at cave 9« 

The neighboring caves are caves 4, 13, 8«. and 
Brrrr. 

Uhat now? 13 



i 

I 




Brian, it isn't necessary to take such large rifks with - / 
pits. One of caves 18 and 13 contain a pit. Also, one of 
caves 7, 4\ and 13 tontains a pit. This is multiple evidence ^ 
of a pit in cave 13 which makes it cuyiite likely t^at cave 13 
contains a pit. It is less likeig tnat cave 4 contains d pit. 
Hence, Brian, we might want to'explore cave 4 instead. 

Uould you' I ike to go cave 13 angwag? No 

Ue are now at cave 9. 

The neighboring caves are cavss 4, 13, 8, and 7. 
Brrrr. 
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What now? Info • / * 

Uhat cave would you like to know about? 8 

The neighbors of cave 8 are cavee 6, 9, 13, and 18. ^ 
I t has warhing "Brrrr.**. . ^ 

Uoy^ld you like to know abou^^nother cave? ^ 

I4e are now at cave S. (/ ^ 

The neighboring cavee are caves 4^ 13, 8, and 7. . 

Brrrr. f . * ' . 

Uhat now? 4 

Ue are noM at ca^^\* 

The neighboring caves are cavee 7, 3, and 9. 
Uhat a stench! 



Uhat no 



Figurt E.6 




Stench 



Hu»»»\ 

Cave 3 is a very good cave to' explore, Brian. Cava 3 must 
be next to the Uumpus because we smelled the Uumpus in cave 4. 
Ue know that cave 4 is not next to the Uumpus,* and so cave 4 
is two caves away from the Uumpus. Ope of cav%s 2, 16, and 0 
must be next to the Uumpus/ but we also know that xaves 7 and 
3 are not next to the Uumpus. Therefore, cave 3 must be next 
to the Uumpus, and, if we visit cave 0, ue 11 gain 
'information about the location of the Uumpus. 



Uould you like to go cave 7 anyway? Yes 



Ue are now at cave 7. ' 
The neighboring caves are cavee 17, 4^ and 9. 
Squeak. 
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What noM? 4 _ ^ 
Ue are now at cave. 4, 

Thtt . ne i ghbor i ng caves ara cavaa 7, 3, and 9. 
Uhat a atencM 



Uhat noM? 3 ^ • ^ 



Ue'are nou at cave 3. 

Tha neighboring caved are caves 4, 12, 19, and 18. 
Uhat a stench! 

• Uhat now? 18 * 



Figure E.7 




As it' is quite poeeible that cave 18 contahie the Uumpus, 
Brian, gou might uant to ehoot an arrou into cave 18* before Me 
yieit It. ^ - • . 

Uould you like to ehoot an arrow into cave 18 instead? Yes 

Congratul^t ione, Brian,^you have shoV the Uumpus* 
, YoUr recori is eighVwins and four l^e^es. ^ ' ^ 
Uould yov/l ike to ))lay again? Nd - 

Uell, ^rian, have a nice day. Pleaee look me up next time 
you want to go on a Uumpii hunt/ 



I am returning you to DDT.... 



Page 186 



Xhe . Vumpus ^Advisor 



Appendices 



tesuite Experiments With the Synthetic Studefnt 
~ \ Append i X F 

fol lowing are' the ,V«8uJt8* of the • Synthetic Student 
• expftnjheiQ^. The complete protocols .are,- in f4ct, much more reveal I^g» 



but I together amount to-kie^TdVer a thoueand pages of computer output. 
M-^ editted p6Vtlon- of the last" (Experiment ie , shown in the folloMing 



Appendix. . This protocoJ is repf esentat i ve' of all of the protocolsf 
(except that Sgndi normaUu had a fixed etate and did not "'le#-n"). In 
analyzing the tabies'f/lhe actua*l numbers shown arl^^ llttl^ importance. 
The -key variable is whether or not the given rule is knSwn ^as indicated 

bg ian asteripK following the Famniarlty Values). The- first group of 

' ' ' ?' 

experiments were of $be Type 1 described earllec. 




7 

»8. 
9 
18 

131 
14 
15 
19 



EKpariaant H]th3undi PottMtIng Full Knouladg* 



Bats 



;Uu8or'^ Student Knoulffdge Model 
B .Pits Uuepus' 



6.7838712* 
388.78387* • 
8.8 

79.78387* 
27.7838712* 
. 73.78387** 

e.8- 

22.7838712* 
B.8 • 

0*-0 

8178387127* 

18.783871^ 

3.78387113* 

5.7838712* 

2.78387113* 

,0.9 
8.8 



2.78387U3* 

278.78387* 

8.0 

88.78387* 
27.7838712* 
88.78387* 
8.8-' ^ 
2?|^7838712* 

8.8- 

8.78387127* 
18.78387312* 
2.78387113* 
3.78387113* 
2.78387113* 
.8.8 

e.e 



8.8- 

385.78307* 
4.7838712* 
188.78387* 
82.7838715* 
188t 7838741^ 
'9.78387118* 
62.7838715* 
31.7838712* 

8.8r 

4.7838712* 
24.783^712* 
8 8- 

7! 7838712* 
8.8 

25,7838712* 
29.7838712* 



Syndl * • Student Hode I 



Bats ' 


Pits 


. Uumpue 


• 8.8* 


8.8* 


8.^ 


8.8* 


8.8* ■ 


8.0* 


8.8* 


8.8* 


)*?'8* 


-8.8f 


8.8* 


<^.0* 


8.8* 


8^0* 


0.0* 


8.8* 


8.8* 


0.0* 


8.8* • 


8.8* 


0.0* 




8. 8* ' 


0.0* 


sTb* 


8.8* - 


0.8* 


8.8* 


8.8* . 


0.0* 


* 8.8* 


8.8* 


0.0* 


8.8* 


8.8* 


0.0* 


8.8* 


8.8* 


0.0* 


^ 8.8* 


8.8* 


0.0* 


8.8* 


8.8* 


0.0* 


8.8* 


8; 8* 


0.0« 




8.8* 


0.8*, 



• f 
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EMpwiMnt ulth Syndi PotMttIng Knoul^«ctB« up to Ph«M'2 



/ Uutor't Student Knouladg* ribdci 
Batt Pitt * • UuMpat 



Sgndl't Student Model 
B*tt 



Pits 


Uunputt 


i.e« 


i.e« 


11. e« 


11. e« 


e.e 


i.e« 


i.e«^ 


1.8« 


e.e 


a.e 


I'.e* 


1 . e« ' 


e.e 


e.e 


-e.e 


e.e 


e.e 


e.e 


e.e 


e.e 


e.e 


e.e 


e.e 


e.e 


e.e 


e.e 


e.e 


e.e 


e.e 


me 


e.l9 


e.e 


e.e 


i.e« 



e. B- 

437.783e7« 

e.e ? 

27.783»712» 

i;e- 

27.783e712« 

e.e * 
i.e- 
e.e 
e.e 
e.e 
.e- 
e.e 
e.e . 
e.e 

e.e 

e^e 



e.e- 

235.78307« 

e.e 

p3.783e71S« 

i.e- 

33.>83e71S« 



41. 



e.e 

e.e 

e.e 

i.e- 

e.e 

e.e 

e.e 

e.e 

e.e 



e.e- 

23S.783e7* 

e.e- 

8.783e7127« 
3.783e7113« 
8.783e7127« 

e.e> 

3.783e7113« 

e.e- 
, e.e- 
Xe.e- 

e.e- 

e.e 
' e.e 

e.e 

2! 78387113* 



i.e« 

u.e« 

e.e 

i.e« 

e.e* 

i.e* 

e.e 

e.e 

e.e 

e.e 

e.e 

e.e 

e.e 

e.e 

e.e 

e.e 

e.e 



EKpcriMnt u 

Uutor'a Student KnoMJedge 
Batt Plte.\ 



Synfll Pottaetlng Knouladge up to Phase 3 



Model 
UuMpus 
— 4 



Sundi's Student tlodel 
Bats Pits yUMpuc 



e 

3 



2.783e7113« 
13e.783e7« 

e.e 

21. 7838712*' 
8.783e7127« « 
21.783e712» 

e<e- 

3.783e7113« 

e.e > 
e.e^ 

3, 783e7113« 
6.783e712» 

i.e- 
i.e- • 
e.e 
e.e 
e.e 




2.78387il3« 
92.78: 
8.8 
24.L 

8^ 783Bi'f^7« 
24".7838712»^ 

e.e- S 

8.78387127* 

e.e 
e.e- 

3.783e7113« 
6.783e712» 

i.e^ 

i.e- 

e.e 

e.e 

e.e 



e.e- 

95.783e7* 

4.783e712« 

21.783e71^* 

15.783e713« 

21.783e71Z* 

4.783e712« 

15.7838713* 

8.78387127* 

e.e- 

1.8- A 
'8.78387127** 

e.e- ' 

e.e- 

e.e 

8.783e7127* 
8.783e7l27* 



I.e* 

34.e* 

e.e 

1. e* 

2. e* 

1. e* 
e.e 

2. e* 
e.e . 
e.e 
2.e* 
1.8* 
e.e 
e.e 
e.e 
e.e 
e.e 



1.9* 

'34.e« 
e.e 

1. e* 
2.8* 
4.8* 
e.e 
2.8* 
e.e 
e.e 

2. e* 
1.8* 

e.8 
e.e 
e.e 
e,e 
e.e 



e.e 

34.8* 

2.8* 

5.8* 

4.8* 

5.8* 

8.8 

4.e« 

e.e 
e.e 
e.e 
e.e 
e.e 
e.e 
e.e 
e.e 
3.e* 



* 
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The next of experiments were "of the Type 2 with Uueor initial iy 

aseOMing that Syndi had a^c3»piete knowledge||f- the gane. Because of the 

nBjif^n Of the Phases, once the player is no longer presumed to know a 

elmple rule (like rules ^ end 5),' the higher rulee can no longer be 

degraded. In any case, the player" was reduced to the appropriate phase. 

and aJvite '^culd only be given at the appropriate levrjt. 

• f ^ 

Exi^eriMnt Uith^JJysor Degrading hisrStydent Kodel 





• ' Uusor « Student Knou ledge Model 


Syndi 'r Student 


node 1 , 


Rule 


Bats 


Pits 


Uumpus 




Bats 


Pi^s 


Uumpus 


a 


8.84- • ' J. 


1.8«-«- 


e.e 




i.e« 


1.0» 


i.e» 


1 

2 


12e.8«-»-. 
8.8 


ii2.a!iN- 

8.8 


ii3.e«-«- 
e.e- " 




i.e« 
e.e 


1.0» 

e.e 


l.e» y 

17B»^ 


3 


8.34-+ 


8.34-t- 


' e.34-+ - 


e.e 


e.e 


e.e . 


4 


3.8«-f y^ 


2.8«-»- . 


3.e«+ 


e.e 


e.e 


- e.e 


5 


8.34-^ ^ 


8.8-M 
8^ ^ ' 


e.34-+ - 


' e.e 


e.8 


e.e 


6 


8.8- 


e.e 


e.e 


e.e 


,e.e 


7 


3.8*+ 


2.8»+ 


3.e»-»- 


e.e 


e.e 


e.e 


8 


8.8 


8.8 . 


■ 2.e»+ 


e.e 


e.e 


e.e 


9 


8.8 




i.e« 


e.e 


e.e 


e.e 


18 


1.8«+ 


l/8»+ 


/.e 


e.e 


e.e 


e.e 


11 


3.8«+ 


2i8«+ 


/e.e ♦ 


e.e 


e.e 


e.e 


12 


1.8»-h 


1.8«-t- 


e.e •«■ 


e,e 


e.e 


e.« 


13 


1..8«+ 


8.8 + 


i.e*-t- 


e.e 


e.e 


e.eX'^ 


f4 


1.8«-»- 


8.34 •»- 


e.e 


e.e 


e.e 


•e.e \ 


15 


8.0 


e.e 


e.e •«■ 


0.0 


e.e . 


0.0 


' 19 


8.8 . 


e.e 


,8.0-4 


0.0 


0.0 


0.0 
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Th« latt 'Mt OT^p«r*HiMnte utr« or th« Typ« 3» uh«r« Syndi started 
with • «in^Ml knbwlti^'jerf. thtuitM (ruttt.8t 1» and 2) and "learned'' 
rulaa aa thay Mara ali|)lainad to hary 

EMparraani Mlthi^yndi Laarning 



Rula 



Uuaor*a StudanVKiioMladga nodal 
Bata Pita ' Ugaput 



Sgndl'a Studant flodal 
Bata Pita Uumpua 



B 

1 
2 
3 
4 
5 
6 
7 

A 

18 

11 
12 
' 13 
14 
15 
19 



/ 



ie.0»^ 

e.e 
ii8.a« 

118.0« 

e.e- 

e.e 
,e.e 
i3.e»4- 
38.e«> 
e.e- 
ie.e» 
e.e 
8.e 

8.0 




31. e« 



3.e« 
6.e« 
e.e 
II. e« 

3.0» 
1.8* 

e:e 

. 4.0* 

e.e 

e.e 

i.e« 

i.e« 

e.e 

i.e» 

e.e 

e.e 

e.e 



l.eik 

4.e« 

e.e 

i.e« 

3.e« 

i.e* 

e.e 

3.e« 

e.e - 

e.e. 

i.e« 

i.e« 

e.e 

i.e« 

e.e 

e.e 

e.e 



i.e« 
29. e« 
9.e« 
29. e« 

27. 0« 

29. e« 
e.e 
32. e« 
32. e« 
e.e 
-11. e« 
4.e« 
e.e 
e.e . 
e.e 
e.e 
e.e 



1 

1 
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Scerrdn i o Betireen Syndi LeAnn mnd - Wamon - 
- — - AppiBncfl X G 

, Uhat folloMS 18 a typical "pntocol uith the Synthetic Student and 
Uueor, At various points each had inserted their s current etOcJent model 
values intb the file, ^but these uere deleted to eave space* Also, 
betueen every move both Uusor and Syndi uould output their analyses of 
each mo^e, but most]_g^ ' trfese^ bave alQO bfen delete<^ to coAserCe space 
(the remaining are Bhoun in Italics). The comprete protocole from all. the 
^xperimente are available through the author. 

^ ' Comments made by Uusor uhicK would not normally be displayed for 

the student are enclosed in "*«*\ TKey constitute a trace of Uusor' s 

reaeohing and make Uusor more believable to a human teachpr ae^uell as 

eerving ae an invaluable debugging aid, Syn^T's comments are" much less 

frequent and are encloeed in tftttt* . , S^n6\^ n replies are all listed in 

upper case characters and under l ined. 

Hello, my name is liusor VI I L Uhat is your name? ^(Pleaee 
V* type in your first and last nams. Follow all responsee^wi th 
,a space;} SjNOI LEARN 

Do I have your name right, Syndi Learn? YES 

I teli^e that we have hunted Uu^pti together before. Is 
thJit right? YES 

In this game, Syndi, there will be 28 caves ail 
total, one pit,' and one cdve with bats. 

Just a eecond while I erase my bUckboard. 

Time is 198. 
0»K« , now I will draw up a new warren. 

4oiQ9t I a«i altering the game to create a si tuat ion appropriate 
for a player of phase 8. «3|c« ^ 
Ue are now at cave 11. 

The neighboring caves are caves 14, 1, 9, end 19* 



Uhat now? 
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X 

e<tt«at(oii of the mwes. 
Co*t Oein Index 

0.198270723 0.80131674 4.0416289 
0.198270723 0.80131674 4.0416233 
0.198270723 0.80131674 4.0416233 
0.198270723 0.80131674 4.0416233 

ojter the cave number tndicetes that these 
reflect shooting into the cue before visiting it. 



The folloming is 

Ca»e 

9 

1 

, i4 
figures 



Cffvt 

19 
9 

1 

14 

14 



Cost 

0,0 



V 



0.0 



Qain 

1.0 
1.0 

tto 

1.0 



Index 

10000.0 
10000.0 
.10000.0 
10000.0 



U« ar8 nou at cave 14... 

Th« ntighbor in;}^^aves are cave* 18, 5, 19, and 11> 
Brrrr. I feel a breeze! Ue Must be ncKt to a pit. 

^ * . 

Uhat nou? ■ * ' ■ • . f 

' '. ' . • ' 

The following is my estimation of the moves. 
Cave yCost —Jjain Index 

9 0.19^270723 0.70707436 4.0201313 
1 0.l682f0725 0.79707436 4.0201313 
19 0.198270723 (k. 79707435 4.020t313 
6 0.198270723 0.79707436 4.0201313 

10 0 . 19^70723 0 .79707436 4.0201313 

A "'"after the cave number indicates that: these 
figures refilect s.hooting into the cave before visiting 
Cave Cost Gain Index 

6 0.6 • 0.6 ■ . 1.0 . 

16 tf.<L_ 0.6 ' 1.0 

9 0.0' ■ 1.0 10000.0 

• 1 0.0 1.0 10000.0 . 

19 0\0 1.0 10000.0 

16 



^ Sgndk, uhg not go back to cave 11 uhare ue didn*t , 

get .any uarninge at ait. Froa there ue can eafetg go to 
' cave 1 ujthout riekinfj the pit* Ue ehoutd try not to 
etuBibte into the pit^ae it/uoutctbe fatal* 

I have uWds (rule 1 for the UiApue), (rule 1 for the 



it^ae it/i 
rule 1 foi 

to caveUSinyuag? |^ 



pith*^ and (rule 1 for tKa^tt) in explaining combination 
rula 8. «** V ' 
Uou I d gou I i ke to go 

Ue are nou at cave, 14* " 

Tha neighboTjng qavee are cavee 16« .B, 19» and 11* 
%rrrre I feel a bfeera. 



Uhat no«r 11 
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naioK I have stopped initializing the plager*8 knouledge model 
for the bate because he seems to be Itarning rule 1* >inic« 
««« I am advancing the iftudent to phase 1 for th^ bats as he 
has mastered rule 1* 

I ha'^e stopped initializing the plager*s knouledge model 
fof: the pit because he seem*^ to be l-earning rule L ^« 

I am advancing the student to pliase 1 for the pit at he 

has mastered rule 1. *»* ^ ^ 

«3M( I have stppped'^nitial izing the player^s knouledge iiodel 
for the Uumpus because he seems to be learning rule T. 
'4oM( I am advancing the student to phase 1 for the Uumpue as 
he hair mastered rule 1. )iQMc 
Ue are now at cave 11/ 

The, neighbor ing caves are caves 14, 1, 9, and 19. 
Uhat nou? L - ^ . 

)MQie I am upgrading the pi'ager's receptivity because his move 
to cava 1 is a move that I told him uas good very recently. 

Ue are noH at cave 1« 

The neighbocing caves are cavee^8, 15, and^ll. ^ 
Uheu, uhat a stench! That ^s the smell of the Uumpus. It 
^ans that.ue are.uithia tuo caves of the Uumpus. 

nou?- ^ ' 



1 



meani 
Uhat 



tfif^The folloioing is ''my estimation of t^e moy^es, ^ 

Cave Cost Gain * Index 

6 0,198270723) 0,79283296 3, 9987394 

16 0,198270723] 0.79283296 -3,9987394 

Id^ 0,1 98270^28\ 0 . 79283296 3 , 9'987394 

9 0,198270X23^ 0.792832^ 3,9987394 

16' 0,t 2.792833 27.9283297 

0' 0,1 2. 792833 27 , 9^83297 

< A after the cave number indicates that these 

figures reflect st^ooting into the cave be/ore yisiting i,t. 

Cave Cost -Gain . Index 

6 0.6 0.6 1,0 

16 0,6 0.6 1,0 

19 0.0' . 1.0 10000.0 

9 , 0.0 ' 1.0 10000,0 

16 0.0 1.1 11006,0 

' 0 0.0 1.1 ^ 11000.0 

SHOOT . ^ . ' , ' 

Into uhich cave uould you like to shoot? 8 

Cave 0 can not contain the Uumpus because, If the 
UumpOs uere there, ue uould have sme I led ^the Uumpus. in cave 
11 as cave 0 is ulthin tuci\cayes of cave 11, and, if ue 
ehoot an arrou jnto cave 3, it could ricochet ^back and ki I I 
us. 
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I havt uttdi (ruitt 3 and 5 for th« Uuiiput) 
txplalAinfl cpMbination rule 9« M« « 
tflHf I h«v2 juat " iMrnad'* rutt 3 for th« Uu»put. 
##0 I h«v« jMtt "iMr^nad" rula 5 for the Uu»put. 
Uourd\^oa Wke to shoot into cava. 8 anyuau?*NO 

Ua ara now at cave 1. 

Tha neighboring cavea are cavee 8, IS, and 11. 
UhBt a • tench! The Uuapue it near. 

Uhat nou? SHOOT 



In 

Uttft 
If 



Into which cave would you like to ehoot? 15^ 

^ ^ Po i ng ^ 
You have just shot yourself » 
Uould gou like to take back your last wove? YES 

• Ue are now at cave 1. 

The neighboring caves are^cavee 8, IS, and 11. 
Uhat a stench! 



Uhat now? 



Ue are r\ow at cdvp 15. 

The neighboring caves are caves 1* G, 3, and 10t ' 

Squeak. I hear bats, they must be in one of the neighboring 

caves. 

Uhat a stench! i 
Uhat nou? 



/// Tht following is my estimation of the moves. 



4 



Cave 
ia 

10 
0 

0 

10' 

3" 

6' 

A 

figures 



Cost 

0.108270723 

0.108270723 

0.108270723 

tO. 108270723 

0.108270723 

0.1 

O.t 

0.1 



Gain 

0.78860m 
0.78^60166 
0.7886P160 
0.78860166 
0.78860166 
2.78860166 
2.78860166 
2.78860166 



Uiox 
3.0773476 
3.0773476 
3.0773476 
^.077^76 
3.0776476 
27,8860167 
27.8860167 
27.8860167 



after the cave number iniicates that these 
reflect shooting into the cave before visiting ^it. 



Cave 


Cost 


Gain 


Index 


6 


9.6' 


0.6 ' 


1.0 


16 


0.6 


0.6 • 


1.0 


10 


0.227228603 


0.7828620 


3.4462208 


3 


0.227228803 


. 0.7828620 


3.4462203 


6 


0.227228608 


0.7828620 


3.4462208 


10 


Oi^ 


1.0 


10006.0 


0 


• 0.0 


1.0 


10000.0 


0 


0.0 


1.1 


llOOO.O ' 



J 
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SHOOT » 

Into uh;ch cave uould you I ike' to shoot? 6 ^ 

s , 

Congratulations, §yndi, yo^ have shot the UuMpus* 
Your record 'e one wins and\ one tosses. 
Uould you like to play again? YES 

In thi^ gap^f Syhdi, there uiJ I be 20 caves all 
total, tuo pits, and tuo caves uith bats* 

Just a second uhile I erase my blackboard. 
3*DiQic Time is 149. iwc* 
'O.i(.,/nou I ui 1 1 dr^^fup a nsu uarren. 

4QiQie I an altering ^he gatne to create a situation appropriate 
.for a player of phase 8. 



I 



Ue are rou at cave 3. 

The neighboring caves are caves 7, 8, and 15< 
Ulhat now? 7 *. ' 

Ue are nou at cave 7., \ 

The neighboring caves ar» caves 6. 3, 13. and 18. « 
Squeak. I hear bats. 
Brrrr.' , . 



Uhat nou? 



/// The following is my estimation 

Cave Cost Gain 

0 0.114270098 0.88430280 

. 16 0.114270098' 0.88430280 

18 O.Xt42700M^ 0.88430280 

13 0.114270098 0.88430280 

6 ' 0.114270098 0.88430280 
A after the cave number 

figures reflect shooting intg^he 



Cave 
18 
13 
6 
0 

16 

6 



Cost ^ 
0.36866813 
0.36856813 
0.36866813 
0.0 
0.0 



Gain 
0.8270084 
0.6270084 
0.6279084' 
1.0 
1.0 



of^ the moves . 
Index . 
7.7387077 
7,7387077 
7.7387077 
7.7387077 
7.7387077 

indicates that thhse 
cave before visiting it. 
Index 
1.70364266 
1.70364266 
1.70364266 
10000.0 
10000.0 



ERIC 



Hummmn. 

4aM( Better moves uhich 1 have not mentioned, to the student 
recently are caves 15 and 8. )mt< 

Syndi, ue don't need to risk bats and pits in cave 6 
as cave 1^ is safe. Cave 15 can not contain a pit becauee, 
if a pit uare there, ue uould have felt a breeze in cava 3» 
Ue should avoid pits as they are fatal. Likeuisa, cava 15 
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!• •a.fe from the tithar dangara. 

sM* I hava uaadt (rutat 3 and 5 for pita) in axplaining 
coabinatioo rula 8. *lt» 

tttm I hava ]uat "laarnad" rula 3 for^pHa* ttttlt 

UUU I a» tranafarring'^au knouladga of rut<f 3 for pita to 

bata. ttttA ^ 

UUU I hava^juat *'laarntd" rult 5 for pitt. UUU 

fttttt I a» tranafarring ay Knouladga of rula 5 for pita to 

bata. UUU 

Uould \jou lika^to go^to cava 6 anyuay? W 
Ua ara nou at cava 7. 

Tha neighboring cavaa are cavae.6, 3, 13, and 18. 
Squaak. 

Brrrr. 

Uhat noM?' 3 



Ua are nou at cav«^3. 

Tha neighboring caves are cavee 7, 15, and 8. 

Uhat Qou? 15 

««« J am upgrading the player's receptivity because his move 
to cave IS is a move that I told hia uas gdod vsry rscently. 



Us are noii at'cave 15. 

The neighboring cavss ars cavss 1, 4, 3, and 8. 



Uhat nou? 

/// Tk9 Jolloning is ay tstimation of tke novei. 



Cave 
18 
18. 

40 



Gain 

o.imm? 



Cost 

0.114270008 
'O.ir42f0008 '^.87088217 
^,114270008 0.87088217 



Index 
7.6066466 
7.6066466 
7.6066466 
OtO 1.0 ^ 10000.0 

^8 0.0 ■ 1.0 10000.0 

4 0.0 1.0 10000.0 

i 0.0 1.0 ^ " 10000.0 

A "'" a/tsr th9 covt number indicate* tket these 

figures reflect shooting into the ceve 'before eisiting it. 

Cave Cost Gain Index 

% 18 0.36866818 0.61676847, 1.67067747 1 

. 18 0.36866813 0.61676847 1:67^67747 

6 0.86866818 0.61676847 . 1767067747 . 

0 0.0 1.0 10000.0 
8 0.0 1.0 10000.0 
4 0.0 1.0 10000.0 

1 0.0 1.0 . lOOOO.O 

1 



Us ars nou at cava 1. 
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/ * ' 

* l^e neighboring caves are caves IS, 2, and 9* 
Squeak. / 
Uhat a stench! T • 

Uhat now? 15 . ' 



Ue are nou at cave 15« 

The neighboring caves are caves 1, 4, 3, and 8.^ 



Uhat now? 4 

4oic« Moves which the student seems to have correctly 
i^ientified as worse are caves 2| 14, and S/^ 
4nMt According to combination rule 8, I marking 'ruiee 3 
and 5 for bats because his move is better than cave 2. 4e3it« 
Ue are nou at cave 4. 

The neighboring caves are caves 15, 11, 18, and 2. 

Squeak. 

Brrrr. 

Uhat new? 1^ 

Ue are noilT^Kcave 15. 

The neighboring caves are caves 1, 4, 3, and 8. 
Uhat now? 8 

Moves which the student seems to have correctly . 
identified as worse are caves 2, 11, and 18. imqk 
4nK« According to combination rule 8, I am marking rules 3 
and 5 for bats because his move is better than cave 2* 
Tii0^ I an advancing the student to phase 2 for bats as he has 
mastered rules, 3 and 5. ^mc* 

>Muic According to combination rule 8*, I am marking rules 3 
and 5 for pits because his move i'ft betfer than cave \l. 

4c3Me I am advancing the student to phase 2 for pits as he has 
mastered rules 3 and 5. ^MfM 
Ue are now at cave 8. 

The neighboring caves are caves 15, 19, 13, and 2* 
Brrrr. 

Uhat now? 2 

Ue are now at cave 2. 

Thd neighboring caves are caves 9, 1, 8, and 4* 
UHat a stench! 

Uhat Now? 9 N 

Ue are nou at cave 9. 

The neighboring caves are caves IB, 2, 1, and S. t 
Uhat a stench! 

• • • . ** 
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Uhat nou? 1 

Urn are nou at cave 1.' 

Tht neighboring cavee are caves 15, 2,. 14, and 3* 
Squeak. 

Uhat a itenchl 

* 

Uhat now? 15 ' . 

Ue are nou at cave 15. 

The netghboring cavet are caves 1, 4, 3, and &# 

Uhat now? 3 ' 

Ue are now at cave 3. . 
The neighboring cdves are caves 7« 15, and 8. 



Uhat nou? 0 



4aM{ Movee Mhich the student seees to have correctly 
identified as worse are caves 18, S, 14, 19, 11, 13, 

and li. ««» \ , 

9iaiQK 'According to combination rule 8, I a» Marking rulee 3 
and 5 for the Uumptre because his eove is better than cave 18. 

aioiQK According to coebination rule 8, I a» Marking rulee' 3 
and 5 for bats because his- Move is better than e#ve 14. 

Moic According to combiination rule 0, I aa Marking rules 3 
and 5 for. pits becausa his Move is better than cave 19. 

Ue are now at cave 0.- 

The neighboring caves are caves 11, 16, and 3. 

Uhat a elencM ^ * 

Uhat nou? 



ERIC 



The Jollouiifig t« mj/ estimation of the moves. 
. Coye Cost . Gain Index 

18 0.114270098 0.84986788 ,7.4872728 
6 0.114270098 0.84986788 7.4872728 
10 0.100000001 O.V 8.99999988 
t8 0.100000001 0.9 8.99999988 



6' 0.1. ' 2.9 

10' ^.1 . 2.9 
14 b. Of 68660626 0.9442866 

16 0.0 . , 1.0 
It 0.0 1.0 



29.0000002 

29.0000002 

69.666169 

10000.0 

10000.0 



A after the cave number indicates that these 
figures reflect shooting, into the cave before visiting it. 
Cevit Cost Cain Index 

18 1.0 0.9 0.0 

19 0.6 0.6 l.J^^^ 
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13 0.5 

14 • 0.168666688 
6' ^0.16666 
10' O.I6066 

6 ' ^ O.p 

11 0.0 

16 , 0.0 
11 - 



0.6 

0.442864064 

3.416686 

3.416.686 

1.0 

1.0. 

1.1 ' 



L.O 

2.70310346 
'20.6021603 
20.60216n 
10000.0 
lOO'OO.O 
11000.0 



Humfflfflm* 

*** Better moves which I have rrot wentioned to the etudent 

recently are cave 16. 

Ue are nou at cave 11 • ^ ^ 

The neTghboring cavoQ are 'caves 3, 4, ^7, and 18» 

Squeak. ^ 

Brrrr* 

Uhat noM? 8 . " . ^ 

Ue are nou at cave^B. 

The neighboring ^ves are caves 11, 16f and 3* 
Uhat a stench! [ 

Uha-t nVM? 16 

Moves uhich the student seems to hayp correctly 
identified as uorse are caves 17 and 18* 
Ue are nou at cave 16* 

The neighboring caves are cavss 13, 5, 10, and 0* 
Uhat a stenchl 



Uhat noM? 



my estimation 
Cost Qain 
0 . 1 14270008^ . 8400164 
-C. 114270m : 0.8400 164 
0.114270098 0.8400164 



The following is 

Cave 
6 

18 
17 
10 
13 
10' 
6' 
14 



0.100000001 
0.100000001 
0.1 
0.1 

0.0168^626 



rtfr 



0.9 
0.9 
2.0 
2.0 

0.93336166 



of the 
Index 
7.3611479 
7.3611470 
7.3611479 
8.0990098*, 
8.00909988 
29.0000002 
29.0000002 
68.866603 



moves . 



A "'" af€¥r the cave number indicates that these 
figures reflect shooting into the cave before visiting it. 



Cave 
18 
13 
14 
10' 
5" 
19 



Cost 

1.0 

1.0 

0.168666688 
0.r6666 
0.16666 
0.0 



Gain 
0.0- 
0.0 

0.333616684 
3.416686 
3.416686 
1.0 



Index 
0.9 
0.0 

2.1034483 
20.6021603 
20.6021603 
10000.0 
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> 6 , 0.0 1,0 moo.o 

17 0.0 i.O 10000.0 

a . . ■ ■ 

Us are nou at cave 0, . . 

The neighboring caves are caveUlU Id and 3. 
-^^hat'a stenchr! 

Uhat now? 3 *' ^ 

Ue are nou at clive 3« ^ . ' 
The neighboring caves are caves 7» 15» and 0, 

Uhp now? 15 . ^ • • • 

NUe.ars now at cave 15. 
Thp Neighbor ing caves are leaves 1, 4» 3» and 8« « 

/ 

Uhat now? 1 

Ue are now at cave 1. • ^ 

The neighboring caves are caves 15» 2» 14» and^9. 

Squeak, ' 

Uhat a 8tench> 

Uh#t now? ]Jt ' ^ 

Moves' which the student seems to have correctly- 
identified as worse are caves 13 and 18, ^cJMt ^ 
Hummmm. 

)|QM( Better moves Mhich I have not Rlen^pned to the "efudent 
recently are caves 19, 17/ 10, and 5, loion ) 
Bon Voyage! 
Ue are now at cave 8« 

The neighboring caves are caves 15» 19, 13; and 2« 
Brrrr, 

Uhat nou?"^ 

• 

f^f The jQllowing is my estimation of the moves. 

Cave Cost Gain Index 

> 14 0^168668688 0.333616684 2.1034483 

6 0.114270098 0. 8400164 7.3611479 

17 0.114270098 0.8400164 7.3611479 

18 0.lt427M98 0.8400164 7.3611479 
« /d " 0.100000001 0.9 8.99999988 

10 0.100000001- 0.9 * $.90999988 ^ 

6' 0.1 ^ , 2.9 29.0000002 

to' 0.1 < 2.9 29.0000002 

A ""' ajtor the cave number indicates that these 

figures reflect shooting into the cave before visitinji it. 

Cave Cost Gain Index ; 

18 UO 0.0 0.0 . 
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• 13 

6 

17 
10 

2 



^0. 168668688 
0.16606 " 

0.0 . * 



#.0 

8.410035 

3.410006 

1.0 

1.0 

1.0 



0.0 

2.1094489 . 

20.602190B 

20.6021009 

10000.0 

10000.0 

10000.0 



lie are nbvi at cave 2. \ 

the neighboring caves are cayes 9« 1, 8« and 4< 

Uhata stench! . 

Uhat ndw'? 9 " ^ * ^ , • 

~> ■ 

Ue ace nou at cave 9. 

The.neighbor ing caved are caves 18, 2, 1, and 5. / 
Uhat a stench! V • ^ 

Uhat nou? SHOOT • * 

Into Mh^ch cave Mould you like to shoot? 10 

Poing"^ ^ 

Ue are noH at cVm 9. " ^ 

The neighboring caves are caviira 10. 2-, 1." lnd-5. 
Uhat a stenchi 

Uhat nou? 



i. 



V 



i^// The fqllouing is my e^timtioK of the moves. 

Cave . Cost Qaiit v 

^ 14 0.168660688 0.838616684 

. 6 " 0.114270098 0.84001^ 

17 0.114270008 0.8400164 

18 0\ 114270008 0J4OOIO4 
13 , O.lOOOOOOOi 
10 0.100000001 0.0 
0" 0.1 2.0 

10 0.0 : i.*o 4 10000.0 • 

A after the cave number iniicates that these 
figures reflect shooting inio the cfi^rHeJbre 'visiting it. 

Cave Cost Qain ^ /fnw-r ' 

18 1.0 0^.0 W 

18 1.0 ' f 0.0 

14' .0.168^688 0.98^616684 

■0 • 0.0 r.o 

17 ^0.0 1.0 

' HO 0.0 1.0 

*10 0.0 1.0 

0" tf.tf . • 0.1 • 
18 u • 



Index 
2.1034488 
7.8611479 
7.8611479 
7.8611479 
8.90999988 
8.09999088 
29.000000i 



Index 

0./> 
O.it 

2.1094489 

10000.0 

10000.0 

10000. of. 

10000.0 

81000.0 
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Better novM uhich I havt ntft Mntiontd to th« student 
r#c«ntly *rt eav« B* mm 
» Ut art now it cave IB. 
Th« ralghboring cav«t art oivta 17» 9» 19». and 16. 
What a ttanch!^ ^ 

Uhat now? 17 ' ' . 

«3iait Btttar Moves whicJ^^Fhave not atntlonad to tl)t student 
recently are cave 5. 
Ue are now at cave 17^^ 

The neighboring c^vee aiVtavee 6,^18, 12» and 11. 
Uhat a itenchJ 

Uhat ntfkl 6 ^ 

««» I a» degrading the pi eyerie receptivity becauee hie aove j 
to cave 6 ie a aove that I told h)» wae bad very recently. ^ 

Molt 

Ue are now at cave 6.x 

The neighboring caver ^re caver 7, 12» 17« and 13. 

Brrrr* 

' Uhat a e tench I ' ^ * 
^Uhat nou? 12 > . ^ 

Humaaiii. 

MoK Better movea which I have not Mentioned to the etudent 
recefntly are cave S* ««» 
' Ue are now dt cave 12.* 
The neighboring caVes are cavee 5» 6, 14, and 17.^ 
Squeals. 

p|4hat a etench! ^ * 

Uhat now? 17 

Ue are now at cave 17. . - 

The neighboring cavee are caved 6» 18, 12« and 11* 

Uhat a a tench I 

Uhat now? 10 • / 

Ue are now at cave 10. 

Tha neighboring cavee are 'Cavf| 17, ,9, 19» and IB. , 
Uhat a etench I - ' " 

. Uhat now? 19 . - ' ^ 



Hovee which the etudent eeeae to have correctly 
identified ae uoree are cavee 14 and 13. «»» 

According to coMbinatlon rule 0, I a» aarking. rulae 3 
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and 5 forj;)at8 because hie move Is bettar than cave 14, 

nam According to coablnatlon rula 8, I %m Marking rulet 3 
and 5 Jor pita becauea hit eove la l^ttar than cave 13* 

HuR^eniDi, 

Man Better epves uhrch I have not aantlonad to tha atudant 
recently ere cave 5. 
Ue are nou at cave 19i 

The neighboring cavee are caves 14t 6, 18, and 19« 

Squeak • 

Brrrr, 

What a stench! 
Uhat nou? 

Th9 Jollotoing is my e^ttnottoji 0/ the moves. 
Cave Cost Gain Index » _ 

14 0.168660688 0.06014216400.87081084 ^ 
18 0.114270098 0.81641279 7.186837 
18 0.100000001 0.9 8.99999988 
6' 0.1 2.9 Z9.0000002 

A "'"after the cave number indicates that these 
^"^Jigures reflect shooting into the cave before visiting it. 
Cave , Cost Gain Index •* 

18 1.0 0.0 0.0 

18 1.0 0.0 0.0 

14 0.168666688 0.060142164 0.379814184 
6' 0.0 0.1 01000.0 

18 



are nou at cave 18. ^ 
The neighboring cavee are .caves 17, IS* and 16. 
Uhat a stench! 

\\ now? 18 

Ue are nou at cave 16* 
^ The neighboring cavee are caves 13, 5, 18, and 8. 

Brrrr, 

Uhat a stench! ^ * - - 

Uhat now? SHOOT 

Into which cava wou(d you ttka to shoot? g 

CongratulatiOnSt Syndi, you havs shot the UuApua* 
Your record ie two wins and orfs lessee, 
Uould you tike to play again? YES 

^«Mw2:>.In thia garnet Syndir there will be 28 caves ell^ 
/ total, two pits, and two ceves with bets. 
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Jutt a MQdnd uhilt I traat ay blackboard. 
mm TIaa If 288. »«f . ' 
O.K., noM I \4lll dran up a nau.uarrai*i. 

»*» I a« altarlng tha gaaa to ^aata a altuatlon approprlata 
for a playar of ph*a« 8. «m 

Ua ara now at cava 5. 

Thar nal0Nboc;i^ng cavaa ara cavaa 8, 12, 3, and 19. ^ 
"TttMit now? 8 
Ua ara now at cava 8. 

Tha naighboring cavaa ara cavaa* 5, 4, 6, and 7. 
Squaak. 

Brrrr. 

What a atanchh 

Uhat now? ^ ^ 

Ik 

W Tht foil^Hing U mg utimation oj tht movm. 
Cav* Cost Oain Ini9x 

7 0.114270098 0^88480299 7.7887077 

6 0.114270098 0.88489289 7.7887077 . 
4 0.114170098 0.88480289 7.7887077 
19 . 9.0 . ■ 1.0 10000.0 

12 6.0'. i.o 10000.0 

a. 0.0 1.0 10000.0 

A afUr th9 cffvt numbtr. iniiCQU* that tku* 
figurU rafltet scooting into tko cave btjoro vUiting it. 
Cavt Cost Gain Indn 

7 0:86866818 i. 67286288 1.82422946 
6 0.86868818 0.67^86288 1.82422946- 
4 0.86866818 0.67236288 1.82422946 

19 ^.0 1.0 10000.0 ' 

12 0.0 1.0 iOOOO.O 

8 'qJ 1.0 10009.0 

5 

Ua ara new at cave 5. ^ 

Tha neighbor ini) cavaa ara cfi^aa 8, 3, 12, and 19. 

•* ' " ' 

Uhit noM? 3 ' ' 
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rtovaa which tha at^dant taaat to hava corractly 
idantifi^d aa woraa ara cava^,4, 6, and 7. mm 
Ua ara now at cava 3. 

Tha nrtf^borin]^ cavaa ara cffvaa 18, 9, and 6. ^ 

Uhat noH? 18 

Ua ara now at cava. 18. 

Tha nalghborlng cavaa Va ca^a 3, 17, and 14. 



r*« \hmpvis AdifUor 

V 

Uhat nou? I> ^ 
Ut art-nou at cavt 17. 

The neighboring cavtt «ra cavaa IS, 18, 11. and 14. 

Brrrr. 
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Uhat nou? 



The 

Cave 
7 
6 
4 

11 
16 
19 
12 
9 

14 ' 
A 

figure* 
C999 

11 

16 

7 

6 

4 

19 

12 

9 . 

14 
14 , s 



following i* my e«ttJMt(0Ji 
Cost Gain 
0.11427(r098 0.86964073 
0 . 1 14270098 0 . 88964078 
0.114270098 V. 86964078 
0.100000001 0.9 
0.100000001 0.9 
0.0 1,0 
0.0 1:0 
0.0 1.0 
0.0 ' 1.0 

fjUr tho cavo number 
reflect shooting into the 



Cost 

0.6 

0.6 

0.3686681^ 

0.36866813 

0.36lt66813 

0.0 

0.0 

0.0 ^ 



Gain 

0.6 

0.6' 

0.63690306 
0.63690306 

0. 63690806 
1.0 

1. « 
1.0 
1.0 



of the mowes. 

Index 
7.6096211 
7.6096211 
7.6096211 
8.99999988 
8.99999988 
10000.0 
10000.0 

mifo.d 

10000.0 

indicates that these 
cava before visiting it. 
Index " 
1.0 
1.0 

1.7268338 

1.7263388 

1.7263338 . 

10000.0 

10000.0 

10000.0 

10000.0 



Ue ars noM at cava 14, 

Jha nalghboring eavaa are cavai 8, Hi 18, and 17. 
Squtak, 

Br'rrr. 

Uhat. now? 18- ^ * • 

Ut art nou at cava 18, 

Tha na ighboring cavaa are cavaa 3« 17i and 14. 

Uhat nOM? 3 ' 



Ue are noM at cava 3. 

Tha neighboring cavae are cavee 18, 9, and 5. 

Uhat now? 9 
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Hovee which the ei^ent eeeae to have correctly 
identified ae MOree are cavee 9 and 11, «»» 

'According to coabination rule 0, I tf« aarking rulee 3 
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' i. 

, 1^ 5 for bfrtt b«9«uM.hit mv« It^bttt^r than c«v« 0. m« 
' «» According to combination rult 8« I M Mrkl-ng ruUt 3 
and 5 for pite bacauM-hit mv« it bat tor than cava 11. 

lia art now at cava 9. * . 

Tha naiehboring cavaa ara cavaa 3, 6« 10, and 2. 

I^t a ttanchl . ^ 

*, , 

Uhat noH? 6 ^ . 

. Ua art /i$u at cava 6. 

Tha na Ighborlng cavtt ara cavtt 8» S» U, and !• 

Brrrr. 

Uhat a ttanchl 
Uhat now? 9^ 
Ua art hom at cava 9. 

Tha*naighbor ing cavtt ara cavaa 3» 6» 18, and 2. 
*Uhat a atanchi * 

Uhat nou? 10 

mm Hovaa which tha atudant aaaat to hava corractly 
« idantifiad aa u^at ara cavaa 1, 4, 7/ and 11. Mt 

«»» According to coabinat i«^ 'rula 0, I aa Marking rulaa 3, 
5. and 19 for tha Uuaput bacauaa hia aova ia battar than 
cava>l. «»» 

*»» I aa advancing tha atudant to phata 2 for Uuaput aa 
ha haa aatttrtd rulaa 3,^5, and 10. »q» , 
«aiD^ Accordlr^ to coablnatlon rula 0, I* aa aarking'rulaa 3 
and S for pita bteautt hit aova^ la battar. than cava 11. 



Ua art nou at cava 10. 

Tha nalghboring cavtt art cattt 9, 2» 18^^ and 13. 
Uhat a ttanchl 

Uhat now? 2 , * ; . 

Ua ara r^ow .at cava 2. 

Tha nalghboring cavaa ara cavaa 10» 0, 16i and 9. 
Squaak. 

Uhat a ttanchl 

Uhat now? li ' * 

Ua ara now at cava 10. 

Tha nalghboring cavaa ara cavaa 9, 2, 16, and '13. 
Uhat a atanch! ! 

Uhat now? 1£ 

Mov** Mhieh th« ■tuct«nt MM*, to have cbrrtctly 
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tdtnttfted MOrM are caves 16, 13* and 0^ «»» 

«»» According to coabination rule 0, I aa a«rklng ruiaa 3 

and 5 for the Uuaput bacauaa hi a aova li bat tar than cava 16. 



According to coabinatlon ruta 0, I aa aarklng ruiaa 3 
and 5 for bata bacauaa hia aova ia battar than cava JBt 
Ua araj^ou at cava 15. 



Tha neighboring cdvea are cave^l?, 19, and 18« 
Uhat now? ' 



i 



*** TAe 

Cave >> 
7 

i 
11 

1' 

16'' 

0 

J2 
13 
10 

A 

figures 
Cave 

11 

7 

4 

0 

1' 
10' 

. 12 

13 

19 



Solloming is ay estimttion of the i»o»9s. 

Index I 
7.3611470 I 
7.3611470 
$.09000088 
28 * 1 

28.400104 . * 
68.896603' 
lHOOO.O 
10000.0 
10000.0 

iniicates that these 



Cost 

0.114270098 

0.114270008 

O.lfiOiOOOOl 

0.1 

0.1 



Gain 

ii. 8400104 
0.8400104 
0.0 
2.81 

2.8400164 



0.0168666626 0.03336166 



0.0 
0.0 
0.0 



1.0 
1.0 
1.0 



after the caoe number 
reflect shooting into .the 



Cost 
1.0 

0.63903916 
0.63903916 
0.168686688 
0.101094909 
0 . 127701s 
0.0 
0.0 
0.0. , 



Gain 
0.0 

0.3S8378894S 
0.358378894 
0.333616684 
8.6061280 
4.0427018 
N 1.0 
1.0 
1.1 



cave before visiting it. 
Index 

0.0 

0.OO41984 

0.OO41084 

2.1034483 

21.704360 ' 

31.M2406 

10000.0 

1000.0.0 

11000.0 



Huaaaa. 

4cm Better aove,e uhich I have not aentloned to the etudent 
recently are cava 13.'«*« 

> Cave 13. is a very good cave ^tb explore, 'Syndt.'aa we 
know that one of cavee 2 and 13 aust be next to the Uuapue. 
Cave 10 aust be exactly ti40 cavee away froa the Uuapue 
becauee we eaellad the Uuapue In cave 10. Thie aeane that 
cave 10 ie within two cavee of the Uuapue. Ue aleo know 
that cave 10 ie not next' to the Uuapue. Hence cave 18 ie 
exact iy two cavee away froa the Uuapue. Therefore one of 
cavee 9* 2, 15, and 13 auet be next .to the Uuapue, but 
neither, of cavee 9 aod 15 are next to tha Uuapue. ThIe 
aeane that one of cavee*2 and 13 auet be* next >o the(Uuapue, 
and eo If we vielt cava 13 we will gain Inforaatlon about 
tha location of the Uuapue. 

*«« I ha^ ueedt (rulee 8, 4, and 7 for tha Uuapue) In 
explaining coabination rule S»' M» 

Page 127 
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> ### I hav* jutt "iMrntd" rul* 8 for th« UiMiput. ttUU 

UnU»\ hava jutt "laarnad" rula 4 for tha Uu«pu8. UUU 

m Lhava JuaV "laarnad* rula 7 for tha UiMpua. ### 
Uould you lika to go to cava 19 anyuag? 

« * • 

This •Kp^riMot continued on for Mny «or« B«M0a ^ 
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